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Baseline Review Decision Request 

• KDP Elements 

1. KDP review focused on: 

How the Project is addressing the DAS Community needs for NAS Access 
The Phase 2 technical content and associated resource estimates, schedule, and risks 

2. Baseline review focuses on: 

• Phase 2 execution plans including project controls for the execution 

• Readiness to baseline the Phase 2 Portfolio and associated needs, objectives, 
deliverables, requirements, resource estimates, schedules, and risks 

• Technical Challenge cost and schedule are adequate estimates that reflect the scope, 
objectives and requirements. 

• Phase 2 portfolio has sufficient reserves, addressing both known and unknown risks 

• Center evaluations of ability to execute Phase 2 Portfolio 

• Decision the Project is seeking today 

- Approval to proceed with baseline plan 
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Baseline Review Outline 


• Project Overview & KDP/KDP Follow-on Outcomes 

• Phase 2 Baseline Development 

• Baseline Content per Technical Challenge (will step through details for TC-ITE) 

• Non-Technical Challenge Work 

• Project Summary 

• Project Control Processes & Governing Documents 

• Briefing Summary 

• Center Endorsements 
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Project Goal, Research Themes, & Technical Challenges 


Goal: Provide research findings to reduce technical barriers associated with 
integrating Unmanned Aircraft Systems into the National Airspace System 
utilizing integrated system level tests in a relevant environment 



Research Theme 1: UAS Integration - Airspace integration procedures and performance 
standards to enable UAS integration in the air transportation system 

Research Theme 2: Test Infrastructure - Test infrastructure to enable development and 
validation of airspace integration procedures and performance standards 


TC-ITE: Integrated 
Test & Evaluation 



TC-SAA: 

SAA Performance 
Standards 


TC-HSI: Human 
Systems Integration 


TC-C2: 

C2 Performance 
Standards 
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KDP/KDP Follow-on Results & Action Summary 

• KDP Outcome 

- Approved to proceed with the execution of TCI (TC-SAA), TC2 (TC-C2), TC3 (TC-HSI), 
and TC6 (TC-ITE) 

• KDP Actions to be statused at Baseline Review 

- LVC-DE Enhancements Secondary Action 

• KDP Follow-on Outcome 

- Approved to proceed with execution of more robust TC6 (TC-ITE) 

- Approved to proceed with the path forward toward identifying future LVC-DE 
enhancements 

• KDP Follow-on Actions to be Addressed at Baseline Review 

- Focus on aligning the work in TCI (TC-SAA), TC2 (TC-C2), TC3 (TC-HSI), and TC6 (TC- 
ITE) to meet stakeholder need dates and baseline "full success" in these areas 

- Remove the work that was in TC4 and TC5 from the technical challenge structure for 
greater flexibility 

• The Non-Technical Challenge work should be far-reaching and address future challenges 




5 


Baseline Review Outline 


• Project Overview & KDP/KDP Follow-on Outcomes 

• Phase 2 Baseline Development 

• Baseline Content per Technical Challenge (will step through details for TC-ITE) 

• Non-Technical Challenge Work 

• Project Summary 

• Project Control Processes & Governing Documents 

• Briefing Summary 

• Center Endorsements 
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Baseline Review Preparation 



• Developed Phase 2 
Baseline through the 
examination and 
development of the 
following: 

- TWP/Technical Content 

- Schedule 

• Roadmap & Progress 
Indicators 

- Risks 

- Budget 

- Monitoring & Control 
Processes 

- Governing Project 
Documents 



• Additional activities 

- ARD Coordination Meetings 

- Pre-Briefs to Host Center and ISRP 
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Technical Baseline Development 


Technical Challenges (TC) 


Technical Work Packages (TWP) 


Defined by 
subproject focus 
area to develop 
research findings 


Defined at KDP 

Defined by systematic 
groupings of SPs 

Provided technical detail 
and ability to manage SP 
activities and tasks 

TWP Objectives are 
documented in the 
Project Requirements 
Document (PRD) 


Schedule Packages (SP) 


New for Baseline Review 

Defined the Phase 2 technical 
content and significantly 
enhances technical detail 

Defined by discrete activities 
and tasks necessary to 
accomplish a TWP 

Basis of Estimate (BOE) defined 
at SP level 

SP Objective, Approach, and 
Deliverable defined the Phase 
2 technical baseline and are 
documented In Project 
Requirements Document (PRD) 
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Community Need Addressed by the SP 
State of the Art Prior to the Project 


Objectives 

Approach 


Contributions by Phase 1 and/or other SPs 


Deliverables and Plans for Use 


Benefit to the Community 


Dependencies to other SPs or TWPs 


Key Collaborators/Formal Partners 


Schedule 


Success Criteria 


Cost/Resources 
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TC Requirements Summary and Example 



Requirements Summary 

Total 

TC-SAA: Sense and Avoid Performance Standards Requirements and Technical 
Baseline 

29 

TC-C2: Command and Control Performance Standards Requirements and Technical 
Baseline 

16 

TC-HSI: Human Systems Integration Requirements and Technical Baseline 

13 

TC-ITE: Integrated Test & Evaluation Requirements and Technical Baseline 
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Example from Project Requirements Document (PRD) 

Rec 

uirement 

Verification 

Method 

Technical Baseline 

Number 

Description 

Objective 

Approach 

Deliverable 

TC SAA: Sense and Avoid Performance Standards Requirements and Technical Baseline 

S.l.30.1 

The SSI Subproject 
shall report on the 
Interoperability of 
Self-separation and 
Collision Avoidance 
Functions Airspace 
Concept Evaluation 
System (ACES) 
Simulation 
(reference 
Integrated Master 
Schedule UID4767; 
SPS.1.30). 

1 

Analyze the 
interoperability 
of self- 
separation (SS) 
and collision 
avoidance (CA) 
algorithms and 
the level of 
integration 
required for self- 
separation and 
collision 
avoidance 
algorithms. 

Builds on research findings from Sub- 
Function Tradeoffs with Unmanned 
Aircraft System Performance ACES 
Simulation. 

Create new ACES architecture to 
interact within different community 
defined concept of operations. 

Conduct NAS-wide fast-time 
simulations to analyze the trade-off in 
performance of different self- 
separation and collision avoidance 
interaction concepts. 

Report documenting 
guidelines for SS and CA 
algorithms interoperability 
including SS and CA 
interoperability requirement 
recommendations 
for SC-228 DAA Working 
Group MOPS (reference 
Integrated Master Schedule 
UID4767; SPS.1.30). 

Briefings to RTCA SC-228 
DAA Working Group if 
requested(reference 
Integrated Master Schedule 
UID6319; SPS.1.30). 
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Baseline Review Outline 



• Project Overview & KDP/KDP Follow-on Outcomes 

• Phase 2 Baseline Development 

- Technical 

- Schedule 

- Risk 

- Budget 

• Baseline Content per Technical Challenge (will step through details for TC-ITE) 

• Non-Technical Challenge Work 

• Project Summary 

• Project Control Processes & Governing Documents 

• Briefing Summary 

• Center Endorsements 
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Integrated Master Schedule Review 



Team 1 Focus: Center execution internal to a subproject 

- Responsible Leads: DPMfs 

- Focus Areas: 

• Verify Project and Center processes are represented and appropriate time is allocated 

• Verify fidelity and realism of schedule dates and milestones 

• Verify that all activities end with a product 

• Verify all internal and external dependencies are captured accurately 

• Identify potential schedule risks 

Team 2 Focus: Project execution across the subprojects 

- Responsible Leads: Project Office 

- Focus Areas: 

• Verify all dependencies across TWPs and identify missing dependencies 

• Verify all dependencies with external organizations (e.g. RTCA, FAA, SARP, ITU-R, etc) 

• Confirm all external risk mitigation efforts that require resources are captured 

• Began development of a project roadmap; updated Progress Indicators, and milestones 




Baseline IMS Development 



• Comments from both teams rolled into a project Comment Resolution Matrix 
(CRM) and resolved 

• CRM generated several strategic changes to the schedule including: 

- Deliverables across subprojects 

- Technology transfer 

- Export control processes 

- Synchronized and executable schedule 

• Two Schedule Summit meetings held to ensure an achievable schedule 

• The Project IMS is currently a network of activities in a common format used 
to ensure the project meets it's commitments 



r 
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Schedule Roadmap 


Schedule roadmap uses and attributes 

- Provided a template for the definition of milestones 


- Documents dependencies across the schedule packages 

- One page snap shot that displays the status of technical 
challenge activities (e.g. green, yellow, red) 


FY14 


FY15 


FY16 



Roadmap is a tool that aids in the management the Project 






Schedule Roadmap (cont.) 






Milestone Definition 


Level 1 Milestones primarily include, but are not limited to: 

- End of execution periods for Integrated Events and comprehensive inputs to Stakeholders 

- All Annual Performance Goals (APGs) and Annual Performance Indicators (APIs) 

Level 2 Milestones primarily include, but are not limited to: 

- Start of execution for Schedule Packages 

- Tech Transfer reporting for Schedule 


Other key components In the IMS are defined as "Deliverable"' and "Receivable" and 
tracked as milestones 

- Deliverable milestones document items for which multiple subprojects or centers have a 
dependency 

- Receivable milestones are opposite of a deliverable milestone in that they document the 
need for the deliverable 


Progress Indicators 




Execution of Schedule Package activities are the L2 milestones for Progress 
Indicators. 


HTCA 


SC-22S 

^hllEpap«^^ 


Preliminary 
Pti 1 MOPSA 


Final Ph 1 
MQPS/\ 


Tech Transfer 


WRC SAHP 


1013 


201S 


2016 


CalendarVear 


2Q12 


PI-7 


Individual contribution towards 
achieving the overall technical 
challenge 

- High = 2, i.e. Integrated Tests 

- Moderate = 1, i.e. multiple 
subproject technologies 
assessed 

- Low = 0, I.e. foundational 
activities 

Normalized and placed on a 10 
point maturity scale 

- The more steps in the TC, the 
smaller amount of progress per 
step 


+ Tech Transfer 


♦Complete 

to RTCA 


♦ in work / On track 

(+ other orgs) 


♦ in work / Late / Not impacting L1 

♦ in work / Late / Impacting L1 

I Inputs from 


ONot yet started 

1 RTCA 


0L2 Milestone 1 ^Vl 1 Milestone 


Progress tracked using a red, yellow, green scheme 



Baseline Review Outline 



• Project Overview & KDP/KDP Follow-on Outcomes 

• Phase 2 Baseline Development 

- Technical 

- Schedule 

- Risk 

- Budget 

• Baseline Content per Technical Challenge (will step through details for TC-ITE) 

• Non-Technical Challenge Work 

• Project Summary 

• Project Control Processes & Governing Documents 

• Briefing Summary 

• Center Endorsements 
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Re-examination of risks 



Goal: To have a well defined set of risks that is consistent with the Phase 2 content, 
with descriptive titles and risk statements, detailed mitigations, and well defined 
impacts 

Held risk workshops to reformat and re-examine current risks and identify potential 
candidate risks 

Updates Include: 

- Risk statement and 
Context defined in a 
common format 

- Detailed explanation 
of the original impact 
and resultant 
consequence score 

- Defined cost to 
implement mitigation 

- Updated LxC after 
each associated 
mitigation complete 

Risk score card 
updated/tailored from 
ISRP risk scorecard 




Med 


Current LxC 

(iKshncal = #. 
Schedule = tf, 
C05t=fl) 

Target L « C 
sxs 

Qpt a Datg 

M/DtWV 

mt/] 

ELaonM 

CloaufePate 

M.'DD.YV 


Risk Management: UAS-NAS Risk Form 



Risk 

Rfsk Statomant 


Oriflinal Impact 

Category 

Gufl&n th? Ccndrcn : 


Tecl^tcal = #; horfioor?- 

mah ID; 

Ccn::Dquc-ncc- will docut . 


Schoduki - Expbr^liDnfDr&cGri] 

Risk Owner; 

TC Of 
Suhpf^ot 

Ccitioallly 



- Jr; ^pbrioliDn fbr ocora 


Status 


RiskApproaGh: 


m 


MitIgatliHii Step/Task Descrlptian ; 

Co!^ to rmplement 

Ilf ^r^riii^rcrrl- 
budfri;i 

Start 

Date 

End Date 



$ 

H.'DD.YV 

H.'DD.YV 

tivA 


S 

MOOiTr 

UOOiTY 

diH 


Hationala iGrClDsura; 



UAS-NAS Risk Scorecard 



LIKELIHOOD " 

5 

Very High 

Quaiitative: Nearly certain to occur. 

Controls have little or no effect. 

4 

High 

Quaiitative: Highly likely to occur. 

Controls have significant uncertainties. 

3 

Moderate 

Quaiitative: May occur. 

Controls exist with some uncertainties. 

2 

Low 

Quaiitative: Not likely to occur. 

Controls have minor limitations /uncertainties. 

1 

Very Low 

Qualitative: Very unlikely to occur. 

strong Controls in Place 




Criticality 


Med 


Low 


High 



CONSEQUENCE 

1 

2 

3 

4 

5 

Technical 

Negligible Impact 
to Objective, 
Technical 
Challenge, 
Technology 
Maturation 

Minor Impact to 
Objective, Technical 
Challenge, 
Technology 
Maturation 

Some Impact to 
Objective, Technical 
Challenge, Technology 
Maturation 

Moderate Impact to 
Objective, Technical 
Challenge, Technology 
Maturation 

Major Impact/Cannot 
Complete to Objective, 
Technical Challenge, 
Technology Maturation 

Cost 

< 1% Total Project 
Yearly Budget 

1% - 5% Total 
Project Yearly 
Budget 

5% - 10% Total Project 
Yearly Budget 

10% - 15% Total Project 
Yearly Budget 

>15% Total Project 
Yearly Budget 

Schedule * 

Level 2 
Milestone(s): 

< 1 month impact 

Level 2 
Milestone(s): 

> 1 month impact 

Level 1 Milestone(s): 
<1 month impact 
Level 2 Milestone(s): 
< 2 month impact 

Level 1 Milestone(s): 

> 1 month impact 
Level 2 Milestone(s): 

> 2 month impact 

Level 1 Milestone(s): 

> 2 month impact 
Level 2 Milestone(s): 

> 3 month impact 


* Note: LI = ISRP L2 = Project 
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Baseline Review Outline 



• Project Overview & KDP/KDP Follow-on Outcomes 

• Phase 2 Baseline Development 

- Technical 

- Schedule 

- Risk 

- Budget 

• Baseline Content per Technical Challenge (will step through details for TC-ITE) 

• Non-Technical Challenge Work 

• Project Summary 

• Project Control Processes & Governing Documents 

• Briefing Summary 

• Center Endorsements 
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Baseline TWP Resource Estimate Development 




• Developed TWP budgets using input from Center Labor and WYE rates with added 

inflation, external contractor estimates, industry estimates, and collaboration agreement 
in-kind contributions 


- TWP spreadsheet was developed to track and summarize costs by Center/TC 


• Each TWP underwent an Independent Cost Assessment (ICA) review by the Centers Jul - 
Aug 2013 

- Applied information and lessons learned from ICA to TWP resource updates in preparation for 
Baseline Review 


• TWPs modified to address KDP Actions 

- Increased resources for TC-ITE to increase robustness 

- Decreased resources for Certification and sUAS 


• Additional Updates 

- NRA projected budget was zeroed out in FY14 and FY15 for activities in FY15 and FY16, 
respectively 

- Allocated reserves towards risk mitigations for TC-C2 and TC-ITE 



Baseline Review Outline 



• Project Overview & KDP/KDP Follow-on Outcomes 

• Phase 2 Baseline Development 

• Baseline Content per Technical Challenge (will step through details for TC-ITE) 

- TC-ITE 

- Technical Challenges & Progress Indicators 

• TC-SAA 

• TC-C2 

• TC-HSI 

• Non-Technical Challenge Work 

• Project Summary 

• Project Control Processes & Governing Documents 

• Briefing Summary 

• Center Endorsements 
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TC-ITE: Integrated Test and Evaluation 




- Test Infrastructure 

• Test infrastructure to enable development and validation of airspace integration 
procedures and performance standards. 



Develop a relevant test environment for use in generating research findings to develop 
and validate HSI Guidelines, SAA and C2 MOPS with test scenarios supporting 
integration of DAS into the NAS, 


TC-ITE: Integrated 
Test & Evaluation 


TC-HSI: Human 
Systems Integration 



TC-SAA: 

SAA Performance 
Standards 


TC-C2: 

C2 Performance 
Standards 
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IT&E Integrated Test Flow 

IHITL 


FY14 


FY15 


IHITL Development 


oo 


-o- 

o 


Rqmts /\SRR SWRR 

Peer Reviews (11/6-7) (12/19) 

(9/11-12, 16) 


&FDR 

(3/4-5) 

TRR 

(5/30) 


#o O 






Preliminary MOPS Development 


; Preliminary 






I 


FY16 


MOPS Verification & Validation 





I ; MOPS Inputs 
I lAug 2014 

:fY 14APG 
k hiTL Report 


Preliminary MOPS 
July 2015 


FY13APG /p Scenario 

LVCCharac. Build-up 

Report Trial Planning 
(8/ 30 / 13 ) — P ovo l o p mont 


Final MOPS 
July 2016 


Component 

Testing 


V&V 


IHITL Sim 
Complete 
( 8 / 8 ) 


- Level 1 Milestone 

- Reviews 

- Annual Performance Goal 

- Development Milestones 


IHITL Description 


Purpose 


Approach 



ZFW (Dallas-Ft Worth) 



ZOA (Oakland Center) 


Test 

Duration 


Tech 

Transfer 

Project 

Benefit 


■ 

• 'Evaluates and measures the acceptability of algorithms and pilot guidance 
displays with ATC operations with increased simulation fidelity by adding 
CNPC time delay, a proof of concept GCS, and VFR cooperative and non- 
cooperative traffic 

• 2 LVC configurations to be tested (Configl & Config2) 

• Configl: Ames/Armstrong connectivity (ATC and Pilot test set-ups) 

• Config2: LaRC/Ames connectivity (SAA-CA interoperability) 

• Scenarios - Class E airspace operations near major TRACONs 

Jun-Jul 2014 

• Configl Test Set-up 1: ATC - 3 weeks (15 Controllers) 

• Configl Test Set-up 2: DAS pilots - 2 weeks (10 pilots) 

• Config2 Test Set-up: ATC - 3 weeks (6 Controllers) 

• Validated SAA, C2, HSI performance requirements and guidelines 

• Community insight into LVC Infrastructure capabilities 

• Validates Project models 

• Risk reduction for SAA Initial Flight Test Series and Flight Test Series 3 

• Foundational infrastructure integrated test supports SAA Initial Flight Tests, 
FT3, & FT4 
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Preliminary MOPS Development 


Preliminary 
I MOPS Inputs 
Jan 2015 



IT&E Integrated Test Flow 
SAA Initial Flight Tests 


FY15 

_J_ 




FY16 

_x_ 


MOPS Verification & Validation 





Preliminary MOPS 
July 2015 


Level 1 Milestone 


Final MOPS 
July 2016 


SAA Initial Flight Tests 



EAFB Restricted Airspace R-2515 


Test 

Duration 


Tech 

Transfer 

Project 

Benefit 


O 

- Reviews 

- Development Milestones 


SAA Initial Flight Tests Description 


Evaluate SAA Algorithm performance with actual sensor data 
Demonstrate SAA CONORS in real-world scenarios 
Demonstrate LVC distributed test environment 

Ikhana UAS modified with Proof of Concept DAA system (Prototype Air- 
to-Air Radar, SAA Processor, TCAS, ADS-B, Sensor Fusion) 

Multiple encounter geometries (CA and SS) 

Nov 2014 -Jan 2015 (13 flights/2 backups) 

• Nov 2014: Collision Avoidance Flight Tests (UAS vs. Manned) 

• Nov - Dec 2014: Self Separation (UAS vs. Manned) 

• Dec 2014 - Jan 2015: Collision Avoidance Flight Tests (UAS vs. UAS) 

• DAA CONORS and Algorithm flight demonstration 

• Data for validation of sensor models, well clear definition, and SS/CA 
interoperability 

• Conduct flight test risk reduction activities for FT3 and FT4 

• Project's 1^^ live flight test for SAA algorithms and pilot guidance displays 
for real sensor data/uncertainties, real environmental factors 

• Distributed test environment with partner 
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o 

o 

♦ 


- Level 1 Milestone 

- Reviews 

- Development Milestones 


IT&E Integrated Test Flow 
Flight Test Series 3 




FY15 

_J_ 


I 


Preliminary MOPS Development 




i 


FY16 

_x_ 


FT-3 

Start 

7/28/14 



Flight Test-3 Development 

o o 

O 

O 


R(FT3/FT4) SWRR 
(9/11) (10/24) 

AFDR 

(2/17) 

Tech Brief 
(6/10) 


b o 

O' 

O 


ObJ/Req Component 
Testing and 
Scenario Build-up 

Integration 
and V&V 

CST 

5/21 

FT-3 Complete 
(8/14) 

=J 


MOf^S Verification & Validation 

n 




I Final MOPS 
1^ Inputs 
l| Oct 2015 

I 

s. FT-3 Report 
/ (10/15) 


Flight Test Series 3 Description 



Final MOPS 
July 2016 


Honeywell King Ak 

• ADS-B 

• rouuifljtnn, 

• High speed ^ 

^ 



■CPDi 
-Stntway* 

- AuMisei^ UAS Pilot 4i Subject 


Health S Status 
Video 

Traffic (ADS-B) 


Uve Intruder 

• ADS-B 

• Several options 

• NASA King Air 

• NASAT-34C 



Flight Test Series 3 Infrastructure 


Purpose • Flight test prototype SAA & C2 systems utilizing RGCS; conduct integrated flight 
test series to verify Preliminary DAA & C2 MOPS and validate sensor models 

• Demonstrate system integration of surrogate UAS with CNPC, RGCS, and SS 
Algorithms 

Approach • Increase complexity from IHITL through live aircraft incorporation and 
increased definition from MOPS 

• Focus scenarios on testing of SAA (sensitivity, pilot workload, and maneuver 
negotiation), C2 (CNPC Mixed Traffic Flight Tests including Integrated SAA), and 
human factors (RGCS utilized to evaluate pilot information requirements) 

Test Jun- Aug 2015 

Duration • 36 flights/2 backups (3.5 hr flights) 

Tech • First fully integrated flight test including both prototype systems for both DAA 

Transfer and C2 MOPS 

• Initiates verifications of the preliminary MOPS 

Project • Baseline FT4 System Architectures implemented 

Benefit • Baseline flight test scenarios developed and validated 

2 §' 



IT&E Integrated Test Flow 
Flightiest Series 4 



FY14 


^ .III 

- Level 1 Milestone 

- Reviews 

- Development Milestones 


r 


FY15 1 n [ 





FY16 



~TT1 

1 Preliminary MOPS Development 

MOPS Verification & Validation 

Final MOPsI 


Preliminary MO| 
July 2015 


Flight Test-4 Development 
(& Capstone Demo) 


Flight Test Series 4 Description 


Purpose 

• Contribute to validation of Final MOPS; flight test SAA, 
CNPC, and RGCS in more stressed environments 

• Demonstrates systems integration and evaluation of the 
state of UAS concepts and supporting technologies 

• Demonstrate final LVC-DE configuration 

Approach 

Increased complexity from FT3 

• Challenging encounter geometries 

• UAS pilot and ATC negotiation in complex/busy airspace 

• Two aircraft with CNPC to assess link performance 
within the same spectrum 

• Demonstrate CA/SS Interoperability, well clear 
compliance 

Test 

Duration 

Feb - Apr 2016 

• 34 flights/2 backups (3.5 hr flights) 

Tech 

Transfer 

• DAA and C2 system refinements flight tested 

• Contributing to validation of final MOPS 

Project 

Benefit 

• Baseline technologies for Capstone demonstration 



^nalMOPS July 2016 
Inputs 
I May 2016 


-4 Report 
(5/20) 


Component 
Testing and 
Scenario Build-up 


FT-4 
Complete 
(4/14) Capstone 
Complete 
(4/29) 




Flight Test Series 4 








Ik^ona Data Unk 


Traffic (ADS-B 
and Radar) 




-V/4 






— » Rerrwte 
CNPC6CS 
6RC S-3B Honeywell King Air 

• ADS-B . aDS-B 

• 2nd CNPC . TCASIIItim. 

• High speed 



- Voice 

- Health Sl Status 
■ Video 

- Traffic (ADS-B) 



36 sorties and 2 backups (3,5 hr sorties) 
Feb -Apr 2016 


VPN 


ADS-B Out 

live Intruder 

• ADS-B 

* Several options 

• NASA King Air 

• NASAT-34C 
Virtual/Constructive 

Intruders 


Pseudo Pilots 


Displays of Proximal Traffic 
SAA/OAA Algorithms 
Pilot Maneuver Guidance 


Distributed 

Environment/Connectivity 



Multi-Aircraft Control 
System 


Flight Test Series 4 Infrastructure 
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IT&E Integrated Test Flow 
Capstone 


FY14 


^ .III 

- Level 1 Milestone 

- Reviews 

- Development Milestones 




FY15 1 n [ 





FY16 



_ 1 1 1 

1 Preliminary MOPS Development 

MOPS Verification & Validation 

Final MOPsI 



Preliminary MO| 
July 2015 


Flight Test-4 Development 
(& Capstone Demo) 


Capstone Description 


FT-4 

Start 

8/27/15 


II 


AFDR 

(10/13) 



^nalMOPS July 2016 
Inputs 
I May 2016 


Purpose 

• Showcase the technologies developed on the Project, 
specifically: Sense and Avoid, Command and Control, and 
Human Systems Integration in a relevant test 
environment 

• Increase public confidence in DAS 

Approach 

• Demonstrate the RTCA SC-228 Phase 1 MOPS, i.e. 
conduct DAS operations to/from Class A, through Class E, 
Class D, and possibly Class G 

• Demonstration flights will be conducted from a Class D 
airport (e.g. Victorville, CA) and operated in the NAS in 
partnership with the FAA 

Test 

Duration 

Apr 2016 

• 2 flights (3 hr flights) 

Tech 

Transfer 

• These are flight demonstrations and are not intended for 
data gathering 

Project 

Benefit 

• Provides opportunities for partnering with the FAA test 
sites, other NASA Mission Directorates (SMD), industry, 
and academia 


o o 

Component FT-4 /y 

Testing and 1/27 Complete 

Scenario Build-up (4/14) Capstone 

Complete 

(4/29) 



LEGEND: 


- DAA TBchnolDglea 

- Air Traffic 5arvl[»B 


- Lagaciy C2 Links 



Project Operational View 1 (OV-1) 
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TC-ITE: High Level Summary (1 of 3) 


ID 

Schedule Package Title 

Approach 

Deliverable 

MS 

T.1.20 

Submit LVC Leave behind document 

Analysis 

Report 

L2 

T.2.10 

IHITL Scenarios and Airspace Development Baselined 

TPWG/TIM 

Document 

L2 

T.2.20 

IHITL Simulation Test Plan 

TPWG/TIM 

Document 

L2 

T.2.30 

IHITL Distributed Test Environment Revie\ws (SRR, 
SWRR, FDR, TRR) 

Review 

Briefing (PO) 

L2 

T.2.40 

IHITL ICD and Configuration Freeze (all 
code/algorithms finished - checklist) 

Integration 

Document 

L2 

T.2.50 

IHITL Simulation Start 

HITL 

LVC 

L2 

T.2.50 

IHITL Simulation Complete 

HITL 

Report 

LI 

T.2.50 

Integrated Human in the Loop Simulation Assessment 

HITL 

Report 
(HQ, PO, F) 

LI 

T.2.60 

IHITL Relevant Environment Evaluation Report 

HITL 

Report (PO, F) 

L2 



SPs contribute to SC-228 Preliminary and Final MOPS LI Milestones 


Technical Challenge (TC) 


Technical Work Package (TWP) 


Schedule Package (SP) 






Stakeholder Legend: 

C=TC-C2 

S=SARP 

F=FAA 

W=WRC 

SC=SC-228 

Project 

“ Office 
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TC-ITE: High Level Summary (2 of 3) 



ID 

Schedule Package Title 

Approach 

Deliverable 

MS 

T.3.10 

SAA Initial Flightiest Reviews (FRR, Tech Brief/AFSRB) 

Review 

Briefing 
(AFRC, PO) 

L2 

T.3.30 

Complete Partner Functional Flights 

Flight Test 

Report (PO) 

L2 

T.3.40 

SAA Initial Flights Tests Complete 

Flight Test 

Report 

(PO,SC,F) 

LI 

T.4.10 

FT3 Airspace Tested in LVC & FT3 Scenarios Baselined 

Integration 

Document (PO) 

L2 

T.4.20 

FT3 Test Plan 

TPWG/TIM 

Document 

(PO,F) 

L2 

T.4.30 

FT3 Reviews (SRR, FDR, Tech Brief) 

Review 

Briefing (PO) 

L2 

T.4.40 

FT3 Stand-up & Integration - Configuration Freeze 

Integration 

Document (PO) 

L2 

T.4.50 

Flight Test Series 3 Complete 

Flight Test 

Report (HQ,PO) 

LI 

T.4.50 

Integrated Flight Test Series 3 Flight Test Report 

Flight Test 

Report 
(PO, F) 

L2 

T.4.60 

FT3 Relevant Environment Evaluation Report 

Flight Test 

Report (PO,F) 

L2 


SPs contribute to SC-228 Preliminary and Final MOPS LI Milestones 


Stakeholder Legend: 

C=TC-C2 

S=SARP 

F=FAA 

W=WRC 

SC=SC-228 

Project 
“ Office 
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TC-ITE: High Level Summary (3 of 3) 


ID 

Schedule Package Title 

Approach 

Deliverable 

MS 

T.5.10 

Select Capstone Partnerships Complete 

TPWG/TIM 

Document 

L2 

T.5.10 

Baseline Capstone Test Plan Complete 

TPWG/TIM 

Document 

L2 

T.5.20 

FT4 Test Plan 

TPWG/TIM 

Document 

(PO,F) 

L2 

T.5.30 

FT4 Airspace Tested in LVC & FT4 Scenarios Baselined 

TPWG/TIM 

Document (PO) 

L2 

T.5.40 

FT4 Reviews (FDR, Tech Brief) 

Review 

Briefing (PO) 

L2 

T.5.50 

FT4 Stand-up & Integration - Configuration Freeze 

Integration 

Document(PO) 

L2 

T.5.50 

Flight Test Series 4 Complete 

Flight Test 

Report 
(HQ, PO) 

LI 

T.5.50 

Integrated Flight Test 4 Flight Test Report 

Flight Test 

Report 
(PO, F) 

L2 

T.5.60 

Integrated FT4 Relevant Environment Evaluation 
Report 

Flight Test 

Report (PO, F) 

L2 


SPs contribute to SC-228 Preliminary and Final MOPS LI Milestones 


Stakeholder Legend: 

C=TC-C2 

S=SARP 

F=FAA 

W=WRC 

SC=SC-228 

Project 
“ Office 



APG/API 


LI Program (ISRP) L2 Project 
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APG/API 


LI Program (ISRP) L2 Project 
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TC-ITE: Progress Indicator 



“srer 

MOPS 




SC-228 White Papers' 
Dec 2013 


•^AA 


-^AA 


' Preliminary Phase 1 \ 
. MOPS July 2015 J 

f Final Phase 1 
[ MOPSJuly2016. 

" Final Phase 2 
, MOPS July 20U 

A 

A 

//A 

1 

1 

1 

• 

« 

1 

1 

1 

1 

1 

// ^ 

1 il^l 

1 -^AA 1 ;| -^AA 1 



X/ - 1 

— \ — L — 1 


joig 


20IS 


EstMihMlLVC 
ir# restructure 


^ ‘'FTiltilwant 
.£nv.Evel. Report 


( FTBReleyart Env. Eval. Report)- ^ 


C tnt^rated FT4Test Ran 
Baseline Capstone Test Plan 


I I I i 

( imu Relever^t Erv. Eval Report 
jFT3TestRan^ _ 

.-,.1 M ■!_ 

I C SAA initial FT 


( Ccamplete Partner Functionai Fights )=T" 


IHITLSimI 
Test Plan . 





Established 
connection to 
FAATec hCtr 

"ADS-B ' 
Ikhana 
, Demo 


Initiate Flight 
Test Series 2 


SSI Algorithms 
, Integrated into LVC , 


LVCLhv# 
Behind Due 








2012 

2013 

2014 

2015 

2016 


Calendar Year 


Level 1 
Milestone 

0 Level 2 
Milestone 

^Complete 

^ In Work / 
On Track 

♦ in Work/ 
Late- No 
LI Impact 

♦ In Work / 
Late- LI 
Impact 

O Not Yet 
Started 

A Tech Transfer 

1 toRTCA 
(♦ other orgs) 

j Inputs from 
! RICA 
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TC-ITE: Risk Matrix and Summary 




L X C Trend 

J3^ Decreasing (Improving) 
Increasing (Worsening) 
Unchanged 

(T) Indicates a Top Risk 


Approach 

A- Accept RA - Raise 
M - Mitigate E - Elevate 
W- Watch C- Close 
R- Research 



Risk ID 

Trend 

LxC 

Approach 

Risk Title 

5.1.20 

NEW 

3x4 

M 

Unsigned Agreement could 
delay flight test and result 
in the cancellation of SAA 
Initial Flight Tests 

5.1.19 

>=> 

4x3 

M 

Eyetracker System Not 
Installed in RGCS for IHITL 

5.1.10 

>=> 

3x3 

M 

Required Assets for Flight 
Test 3 (FT3) not available 
during test period 

5.1.11 

>=> 

3x3 

M 

Required Assets for Flight 
Test 4 (FT4) not available 
during test period 

5.1.16 

>=> 

3x3 

M 

Completion of ITE Technical 
Objectives that Rely upon 
Formal Partnerships 

5.1.7 

>=> 

2x3 

M 

Distributed Test 
Environment requirements 
for Integrated Flight Test 3 
(FT3) not defined 
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TC-ITE: Risk Matrix and Summary Cont. 


Risk Matrix 




Risk ID 

Trend 

LxC 

Approach 

Risk Title 

5.1.8 


2x3 

M 

Distributed Test 
Environment requirements 
for Integrated Flight Test 4 
(FT4) not defined 

5.1.17 



W 

The T-34 (UA Surrogate) for 
FT3 and FT4 may not be 
available 

5.1.XX 



Candidate 

Parallel efforts of IHITL data 
collection, SAA Initial Flight 
Test and FT3 planning could 
impact FT3 and FT4 flight 
test series 


CONSEQUENCE 



L X C Trend 

J3^ Decreasing (Improving) 
Increasing (Worsening) 
Unchanged 

(T) Indicates a Top Risk 


Approach 

A- Accept RA - Raise 
M - Mitigate E - Elevate 
W- Watch C- Close 
R- Research 
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Baseline Review Outline 



• Project Overview & KDP/KDP Follow-on Outcomes 

• Phase 2 Baseline Development 

• Baseline Content per Technical Challenge (will step through details for TC-ITE) 

- TC-ITE 

- Technical Challenges & Progress Indicators 

• TC-SAA 

• TC-C2 

• TC-HSI 

• Non-Technical Challenge Work 

• Project Summary 

• Project Control Processes & Governing Documents 

• Briefing Summary 

• Center Endorsements 
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TC-SAA: SAA Performance Standards 




UAS Integration 

• Airspace integration procedures and performance standards to enable UAS 
integration in the air transportation system 




Provide research findings to develop and validate UAS Minimum Operational 
Performance Standards (MOPS) for sense and avoid (SAA) performance and 
interoperability. 


TC-ITE: Integrated 
Test & Evaluation 



TC-SAA: 

SAA Performance 
Standards 


TC-HSI: Human 
Systems Integration 


TC-C2: 

C2 Performance 
Standards 
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TC-SAA: Progress Indicator 



g r cA 

MOPS 




Tech 

Transfer 




SC-228 White Papers 
Dec 2013 


' Preiminary Phase 1 ' 

f Final Phase 1 


' Final Phase 2 ' 

. MOPS July 2015 

1 MOPS July 2016, 


. MOPS July 201S . 






I ♦SARP I I »SARP I 


-rr 








JS3k 


TP' 


// 




TQertine Times -p CA-SS 
iftteration Combined HITl 

I Wei Clear AtertVResolution 

( Sirvei lance Rqts (Med Ficteli^) 

. Eff eg of SAA M a neuvysw/ Procedures 


Traffic Display 
Evaluation HtTUIPTS) 



I 



( Sub-function Tradeoffs w/UAS Perf. ^ 

1 

f Comprehensive Eval. 

1 Airsoace Risk Threshold /la 

-CPTSei 

’•*3) ( FTSeries4 )— 


Sensor Model Stress 
Testing 8t Sensitivity 
AnalysisHin 


CA/SS Algorithm Maneuvers 
vs. UA Performance Assmt 


Milestone 
O Level 2 
Milestone 


Irceroperabilicy of 
SS and CA Functions , 


2012 

2013 

2014 

2015 

2016 


Calendar Year 


^Complete 

♦ In Work / 
On Track 

Oin Work/ 
Late- No 
LI Impact 

^In Work/ 
Late- LI 
Impact 

O Not Yet 
Started 


A Tech Transfer 
toRTCA 
(•» Other orgs) 

; Inputs from 
I RTCA 
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TC-C2: C2 Performance Standards 




UAS Integration 

• Airspace integration procedures and performance standards to enable UAS 
integration in the air transportation system 




Provide research findings to develop and validate UAS Minimum Operational 
Performance Standards (MOPS) for terrestrial command and control (C2) 
communication. 


TC-ITE: Integrated 
Test & Evaluation 


TC-HSI: Human 
Systems Integration 



TC-SAA: 

SAA Performance 
Standards 


TC-C2: 

C2 Performance 
Standards 
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TC-C2: Progress Indicator 
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TC-HSI: Human Systems Integration 


UAS Integration 

• Airspace integration procedures and performance standards to enable UAS 
integration in the air transportation system 




Provide research findings to develop and validate human systems integration (HSI) 
ground control station (GCS) guidelines enabling implementation of the SAA and C2 
performance standards. 


TC-ITE: Integrated 
Test & Evaluation 


TC-HSI: Human 
Systems Integration 



TC-SAA: 

SAA Performance 
Standards 


TC-C2: 

C2 Performance 
Standards 


44 




TC-HSI: Progress Indicator 
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Baseline Review Outline 


• Project Overview & KDP/KDP Follow-on Outcomes 

• Phase 2 Baseline Development 

• Baseline Content per Technical Challenge 

• Non-Technical Challenge Work 

• Project Summary 

• Project Control Processes & Governing Documents 

• Briefing Summary 

• Center Endorsements 
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Non-Technical Challenge Work 


Includes far-reaching/higher risk activities with an emphasis on future 
project) capabilities 


(post- 


Source for resources should TC work encounter unknown risks requiring 
additional resources for mitigation 

Long term activities have pre-defined off-ramps/on-ramps to facilitate 
potential TC work needs 

- Off-ramps 

• Clearly defined breakpoints/stopping places within scheduled activities where work 
could be stopped, if needed 

• Benefit to the community gained by tasks accomplished prior to breakpoint 

- On-Ramps 

• New proposed activities, for the following fiscal year, that are aligned with the goals of 
Non-TC work 


Does not have LI milestones 


Non-TC Work on UAS-NAS Project 

- Certification 

- sUAS 

Management activities book kept as Non-TC work 

- LVC-DE Enhancements 


Certification 

Far Reaching/High Risk- Analysis 



Core: Type Certification Basis for 1 LIAS doing 1 type of restricted operation 

Requires a realistic core basis for airworthiness certification, i.e. UAS design and operational 
CONORS feasible to assess from a certification perspective 

Analysis can target extreme/high-risk changes (furthest from core) 

- Benefit: helps define research needs for technology advances and longer term NAS access 

- Project/HQ can prioritize analysis targets 


Example UAS Types ; 

• Self-deterministic navigation 

• Alternative propulsion types 

• Multi-vehicle control 







^ UAS 
Types 


Operatio 

\ 




^ Type Certification 
Basis for 1 UAS 
doing 1 type of 
restricted 
operation 






<k Hi 
\% ■ 




Example Environments : 

• Urban / suburban environment 

• Congested airspace 

• Large variations in speed range 




sparsely 
Populated/Re 


r Environment 


^ngested 
Mixad Eqi^age 

Analysis 



Example Operations: 

• Point-to-point (e.g. package 
delivery or human transport) 

• Loiter (e.g. Comm Relay, 
Traffic Monitoring) 

• Dynamic (e.g. search & 
rescue, wildlife monitoring) 
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Certification Task/Product View Timeline On/Off-Ramps 



Partners/ 

Type Certification Development 

CONORS/ 

(conventional & argument-based) 

Design Data 

ll' 



Analysis & Reporting 


Define CONOPS 
and UAS 
Requirements 


Develop Type Certification Basis 



Analyze and Report on Type 
Certification Basis 


Report on 
UAS Design 
and 

Performance 
Criteria for 
Airworthiness 
Certification 


Analyze and Report on Applicability to Future UAS 
and Operations 

K 




Report on 
Applicability 
to Future 
UAS & Ops 


Evaluate Safety Case, Lessons Learned and Report 


Report on 
Safety 

Substantiation 

Approaches 




3/14 

Authority to 
Proceed 


FY14 


6/14 

Partnership 

Established 


9/14 

Eliminate 
Safety Case 
Work 


FY15 


12/14 3/15 6/15 

Stop work after 
development of type 
certification basis 




9/15 12/15 

Stop work after 
first deliverable 
report on the type 
certification basis 


3/16 6/16 

Stop work after any one 
of the analysis questions. 
That is, there will be 
logical breakpoints 
throughout the analysis 
phase to stop work. 


9/16 
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Small UAS (sUAS) Effort 



sUAS is an on-ramp activity currently funded for FY14 only 


- Collaboration with USFWS on fire detection in Great Dismal Swamp 


Conduct experiments to develop sensor requirements for sUAS fire 

Great Dismal 


RFI 

detection airspace integration 

Swamp Missions 




- Develop processes, procedures, and CONORS for GDS and others to 
use for later operations in the NAS 


Issue an RFI asking for information on sUAS autonomy 
technology applications and benefits: 

- What does the technology do and what are the expected benefits 
over current state-of-the-art? 

- What is required to support the technology with a sUAS? 


\f 


\f \f 


Sensor 


Autonomy 

Rqmts 


Tech 

Report 


Assessment 




Report 


- What is the maturity level of the technology? 

- What is the availability of the technology? (Open, FRND, proprietary) 

- How would the developer work with NASA to bring the technology 
to the sUAS community? 

Use the information obtained to combine with literature searches 
and the GDS experiments to shape the proposed FY15 work 








LVC-DE Enhancement Planning Schedule 



Q2 FY1 3 Q3 FY1 3 Q4 FY1 3 Q1 FY1 4 Q2 FY1 4 Q3 FY1 4 Q4 FY1 4 



First UAS SC 
Meeting held 
Dec 2011 


Capstone Capstone 

Discussion Pians 

Initiated Proposed 

21 May 18Jul 

>^DP Planning/Preparation 


KDP Initiation 
20 Mar 


KDP; Received L 
Enhancement 
10 Sep 


VC-DE 

tion 


Ac 


Inter-Center Aulionomy Study Team 


iCASir 
Initiat 
24 Jii 


■CAST Center Visits and Planning 


ed 


n 


Discussions 
Initiated 
21 M$y 


UAS-NAS/ASP/ISRP Inte 


ractions 


NRC Report 
Expected 
Jun 


Final IQAST 
Briefing 
Aiig 


Technical 
sions 
Johnson 
3 Jan 


Discus 
PK, Murphy 
7 Dec, 


UAS-NAS/ASF' 
Meeting at a|| 
20 Mar 


/iSRP uas-nas/Asp/isrr 
FRC Ongoing l^eetings 


Prepare/Submit Specific 
LVC-DE Enhancement 
Proposal to ARMD AA 


1 Sep 
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Baseline Review Outline 



• Project Overview & KDP/KDP Follow-on Outcomes 

• Phase 2 Baseline Development 

• Baseline Content per Technical Challenge 

• Non-Technical Challenge Work 

• Project Summary 

- Project Office Resource Summary 

- Overall Project Budget 

- Project Top Risks 

- Partnerships and Collaboration 

• Project Control Processes & Governing Documents 

• Briefing Summary 

• Center Endorsements 
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Top Risk Matrix and Summary 



Risk Matrix 


I Risk ID Trend LxC Approach 


Risk Title 




L X C Trend 

J3^ Decreasing (Improving) 
Increasing (Worsening) 
Unchanged 

(T) Indicates a Top Risk 


Approach 

A- Accept RA - Raise 
M - Mitigate E - Elevate 
W- Watch C- Close 
R- Research 


1.1.10 

(T) 

NEW 

3x4 

M 

Output from Test Events has 
value to Project Stakeholders 

5.1.20 

(T) 

NEW 

3x4 

M 

Unsigned agreement could 
delay flight test and result in 
the cancellation of SAA 
Initial Flight Tests 

4.1.8 

(T) 

>=> 

3x3 

M 

Sense and Avoid Sensor Suite 
Availability 

4.1.9 

(T) 


3x3 

M 

Delay of SAA/SSI Technology 
Developments Impact to 
Integrated Test Events 

4.2.8 

(T) 

>=> 

3x3 

M 

Endorsement of HSI GCS 
Guidelines from a Recognized 
Standards-based Group 

4.3.3 

(T) 

>=> 

3x3 

M 

Key CNPC Equipment or 
System Failure 

ISRP 

02 

>=> 

2x3 

M 

Project Focus Changes Due to 
External Influences 
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Med 


Top Risk Matrix and Summary (cont.) 


Risk Matrix 


CONSEQUENCE 


L X C Trend 

Decreasing (Improving) 
Increasing (Worsening) 
Unchanged 

(T) Indicates a Top Risk 


Approach 

A- Accept RA - Raise 
M - Mitigate E - Elevate 
W- Watch C- Close 
R- Research 




Risk ID 

Trend 

LxC 

Approach 

Risk Title 

1.1.4 

(T) 

>=> 

2x3 

M 

The predicted or projected 
UAS mission profiles and 
traffic density estimates used 
by the subprojects for their 
technology development 
efforts may not be realistic or 
accurate 

4.2.9 

(T) 

>=> 

2x2 

M 

Delay of HSI Technology 
Development Impact to 
Integrated Test Events 

ISRP 

05 


1x3 

M 

Inability to Meet UAS-NAS 
KDP-2 (Phase 1-to Phase 2 
Transition) 



Mitigate 
Watch 
*Top Risks 


Current Risks 

Risks presented at KDP 

5/8/14 

9/10/13 

31 

31 

2 

0 

8 + (2 ISRP) 

5 


Changes Since KDP 

- Closed 12 risks 

- Added 14 risks 
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Current Active Collaborations/Partnerships Status 



Partner 

Partner POCs 

Collaboration/ Partnership Activity 

FAA UAS 10 

Jim Williams and Chris 
Swider 

Support by FAA leadership, management, and technical SMEs to 
validate work being done by the Project 

FAA R&D 
Integration 

Sabrina Saunders- 
Hodge 

Formal host of partnership agreements and collaborator for Integrated 
Test Activities 

FAA 

ACAS Xu PO 

Neal Suchy 

Coordinating on collaboration for ACAS-Xu software and associated 
flight tests 

RTCA SC-228 

Working Group Leads 

Conduct modeling, simulation and analysis to support the dev. of MOPS 

OSD SAA SARP 

Steve Cooke and Dallas 
Brooks 

Coordinate government recommendations to RTCA SC-228 and assess 
SAA research Gaps 

General Atomics 

Brandon Suarez 
Scott Edrington 

Ikhana equipped with avionics and Proof of Concept SAA system 
directly supported by UAS-NAS Project 

Rockwell Collins 

John Moore 

CNPC radio development and flight test 

AFRL 

Mark Draper 

Coordinate activities on Vigilant Spirit Control Station 

AFRL 

Paul Schaeffer 

Development of a human interface concept for Jointly Optimal Collision 
Avoidance (JOCA) 

UND 

Michael Corcoran 

Exploring requirements for safe operation of UAS through a series of 
case studies, experiments and flight evaluations 

USMCVMU2, 1 , 
&3 

Lt. Col. Faught 
Maj. Springfield 

Potential support for survey of Marine Corps use of Shadow and other 
UAS and Ground Control Stations 
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Baseline Review Outline 


• Project Overview & KDP/KDP Follow-on Outcomes 

• Phase 2 Baseline Development 

• Baseline Content per Technical Challenge 

• Non-Technical Challenge Work 

• Project Summary 

• Project Control Processes & Governing Documents 

• Briefing Summary 

• Center Endorsements 
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Project Control Processes & Governing Documents 


UAS-NAS Project has several processes for the purpose of monitoring and 
controlling Phase 2 content to ensure a successful execution 

Control processes: 

- Utilize metrics and reporting methods to monitor the Phase 2 execution 

- Are documented in governing Project documents 

Phase 2 Control Processes: 

- Change Management 

- Risk Management 

- Resource Management 

- Management Review Board 

- Schedule Management 

- Technical Management 

- Technology Transfer 

- Non-Technical Challenge Work Management 

- Descope Strategy 


Existing Phase 1 Processes Enhanced for Phase 2 



Change Management 

- Standard process utilizing Change Requests (CR) 
to manage changes to the following elements: 

• LI and L2 Milestones 

• Project Goals, Objectives, and Technical Challenges 

• Technical Baseline, i.e. SP objective, approach, deliverables 

• Project Requirements 

• Budget 



Risk Management 

- Utilizes a Continuous Risk Management (CRM) process 
to identify, analyze, plan, track, and control risks 





Cofiimunicale 

Document 



• Risk Workshops and Risk Review meetings conducted monthly 

• Risks are communicated in ISRP UAS-NAS Risk Review Board, AFRC & Partner Center CMCs 


Resource Management 

- TWP, Budget roll up, and travel spreadsheets used in 

conjunction with standard tools (PMT, Business Warehouse, 
and SAP) to generate phasing plans and monitor status 

Management Review Board (MRB) 


UAS-NAS Management Review Board 
(UAS-NAS MRB) 

Chair: Project Manager 
Meets: Monthly 
UAS-NAS Status on 

•Schedule Variance 

• Cost/Technical Performance Variance 
Change Management Approvals for: 

• Risk Management Updates 

• Change Management Requests 


I Technical | 
I Programmatic | 


- Monthly meeting where CRs and Risks are assessed/ 
approved and resource status and schedule status 
are presented 
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Schedule Management Flow 







Project weekly status is the primary 
means of information flow, 
schedule status, and updates 

Schedule Packages and Milestones 
are the primary means of reporting 
at the project weekly status 

The version controlled IMS contains 
change managed Milestones 


Status to 
ISRP 


Project 

Office 


Progress 

Indicators 


LI Milestones 


ISRP Biweekly 
Status 


ISRP Monthly 
Reports 


i 

i 













IMS 

O 

12 Milestones 


Project Weekly 
Status 1 


Roadmap 

i 




y 




PE &TL Status 
Updates 


PE St TL Status 
Updates 


Legend 

Primary Comimunication Tool 
Informational Updates 


Change Managed 

Version Controlled 


Ripr»eittatlw» TC Tdtlt 


SchBdulE PackagB N 


Active ta ski 
Active TaskZ 
Active Task3 


M/5 

Level 


B<gln Date End Date Status/Pnagrcs /ConctriB 


iBchnical, Schedule, 
Accomplishments, and Issues and 
Concerns Status 


01/01/1-q 02^15/14 

01/2D/14 02/2eA4 

02/01/14 03/31/14 



□eliverabie D 03/15/14 

03/15/14 

! 


Milestone L2 04/01/14 

04/01/14 

} 


complete 

ongoing 

ongoing 


Schedule management 
process is formally 
documented in the SMP 


59 







Technical Decision Making Flow 




Note: Center CE is a source of technical authority for each PE 
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Technology Transfer Process 


• Schedule Package deliverables are 
documented in the IMS, PRD, Roadmap, L2 
milestones, and Pis and are the foundation 
of Tech Transfer 

• Project IMS specifies the planned date that 
the Project Engineer (PE) will have 
'"research findings" to provide to a 
stakeholder as a means of Tech Transfer 


• Schedule Package content is coordinated 
with stakeholders through regularly 
occurring collaborations 


IMS Tech Transfer Representation 




Rapcmntattv* Projsct Ti»k 


Input to MOPS 


••gin Data | End Daia| 


ANSchefkjle 

Packages 

Represented with a — 
dependency for Tech 
Transfer 

Schedule Package A 
Schedule Package B 

— SchMfuie Package N 

Conwnents for FRAC 

Consolidated NASA 
Conunents 

Ol/lS/14 

02/15/14 

03/15/14 

06/29/14 

07/01/15 

07/31/15 

01/15/14 
02/15/14 
03/15/14 
06/29/14 ; 

07/30/15 
07/31/15 1 

1 

1 

1 

^ Schedule Package N 




Plan 

01/01/14 

01/31/14 


Provision 

02/01/14 

01/29/14 


Execute 

03/01/14 

03/31/14 


Analyze 

04/01/14 

04/30/14 


Stakeholder Brief 

05/01/14 

05/31/14 ^ 


Export Control 

06/01/14 

06/28/14 


Final Report 

06/29/14 

06/29/14 


Tech Transfer 
Occurs as Data 
bcGomet 
available to 
stakeholders 




• NASA ARMD Website is used for publicly 
releasable material 

• Secure email and server will be used for 
transfer of controlled data (e.g. ITAR) 



- ABOUT us 




Technology Transfer Coordination 
(UAS-NAS to Stakeholder) 



Monthly/Quarterly Coordination 


Daily/Weekly Coordination 


\/ 


Stakeholder 

Working 

Groups 


• SC-228 


UAS TWP 
Integrated 
Events 





Sub WG Planning 
Key Issues Resolution 
Technical Exchange 
Briefings 


SC-228 

OSD SAA SARP 
FAA UAS Int. Office 




Stakeholder 
Face to Face 
Meetings 


Cross WG Planning 
Key Issues Resolution 
Results Validation 
Briefings 


Annual Coordination 

• SC-228 

• OSD SAA SARP 

• FAA UAS Integration Office 

• ITU-R 




Stakeholder & 
Project Annual 
Meetings 


Strategic Planning 
Project Annual Meetings 
Professional Annual Meetings 
Final Reports/Presentations 


RTCA SC-228 

• Baseline PRD Content 

• Initial Tech Transfer Briefings 

• Final Reports 




FAA 

• Test Plans 

• Final Reports 

OSD SAA SARP 

• Research Findings 


Formal UAS-NAS 
Project 

Deliverables to 
^ Stakeholders ^ 




Formal Stakeholder 
Deliverables 
Influence 


V 


UAS-NAS 


y 


ITU-R 

• Spectrum Analysis 


RTCA SC-228 

• White Papers 

• Preliminary 8i Final MOPS 

FAA 

• Integration Road Maps 

• Rules and Regulations 

OSD SAA SARP 

• Recommendations 

ITU-R 

• Authorization 
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Non-Technical Challenge Work Process & Reporting 



Process 

- Employment of off-ramps assessed as needs arise per Project descope strategy 

- In August of each year, on-ramps will be evaluated for feasibility of incorporation 
into the UAS-NAS project portfolio. The following will be assessed: 

• Proposal alignment with Non-TC work goals, overall health and status of TC work, and 
available resources 


Reporting 

- Project level reporting consists of status every other week at the weekly telecon 
per the template 

- ISRP/ARMD reporting will consist of status relative to major aspects of the work 

• Monthly reports 

• Annual Reviews 


Phase 2 Descope Strategy 

• Constraints 

- Project is primarily FTE and WYE workforce - minimal major procurements 

• General Strategy 

- Established a robust Project Management approach to identify potential impacts 
early to ensure successful execution 

- Use partnership/stakeholder collaboration to mitigate the impact of disruptions 
potentially requiring descope 

• The established relationship with the external community will facilitate the Project's 
ability to understand, assess, and even negotiate potential outcomes resulting from 
disruptions 

- Identify risk mitigations to lessen the impact of disruptions by allocating funds to 
risks 

• Descope Strategy 

1. Use reserve strategies to reduce the impact to the portfolio 

2. Descope Non-TC Work 

3. Examine minimum and full success schedule packages and their associated value 
within the TWP to assess if descope within a TWP is feasible 
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Project Document Tree 


Project 


Technology Development 
Project Plan 
[UAS-PRO-1.1-004] 


Systems Engineering Management Plan 
[UAS-PRO-1.1-007] 


Technology Transfer Plan 
[UAS-PRO-1.1-006] 


Project Requirement Document 
[UAS-PRO-1.1-005] 


Public Outreach Plan 
[UAS-OR-7.0-001] 


SSI, Communication, HSI & Cert Subprojects 


Subproject 

Implementation Plans 


[UAS-SSI-4.1-001] 

[UAS-HSI-4.2-001] 

[UAS-COMM-4.3-001] 

[UAS-CERT-4.4-001] 


Center 

Policy/Procedures 


Change Management Plan 
[UAS-PRO-1.1-002] 


Risk Management Process 
[Resides in the Project Plan] 


Schedule Management Plan 
[UAS-PRO-1. 1-008] 


Integrated Master Schedule 
[UAS-IMS-1.1-002] 


IT&E Subproject 


Subproject 
Implementation Plan 
[UAS-ITE-5.1-001] 


Configuration 
Management Plan 


Risk Management 
Plan 


Mishap 

Preparedness & 
Contingency Plan 


Additional SE 
Documents 


Software 

Development Plans 


Safety and Mission 
Assurance Plan 


Verification & 
Validation Plan 


Center 

Policy/Procedures 
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Baseline Review Outline 


• Project Overview & KDP/KDP Follow-on Outcomes 

• Phase 2 Baseline Development 

• Baseline Content per Technical Challenge 

• Project Control Processes & Governing Documents 

• Project Execution 

• Non-Technical Challenge Work 

• Briefing Summary & Center Endorsements 
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Baseline Review Summary 



• KDP Elements 


1. KDP review focused on: 

How the Project is addressing the DAS Community needs for NAS Access 

The Phase 2 technical content and associated resource estimates, schedule, and risks 

2. Baseline review focuses on: 

Phase 2 execution plans including project controls for the execution 

Readiness to baseline the Phase 2 Portfolio and associated needs, objectives, 
deliverables, requirements, resource estimates, schedules, and risks 

Technical Challenge cost and schedule are adequate estimates that reflect the scope, 
objectives and requirements. 

Phase 2 portfolio has sufficient reserves, addressing both known and unknown risks 
• Center evaluations of ability to execute Phase 2 Portfolio 
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Verbal Center Endorsements 



• Ames 

• Glenn 

• Langley 

• Armstrong 
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Baseline Review Decision Request Revisited 

• KDP Elements 

1. KDP review focused on: 

How the Project is addressing the DAS Community needs for NAS Access 
The Phase 2 technical content and associated resource estimates, schedule, and risks 

2. Baseline review focuses on: 

Phase 2 execution plans including project controls for the execution 

Readiness to baseline the Phase 2 Portfolio and associated needs, objectives, 
deliverables, requirements, resource estimates, schedules, and risks 

Technical Challenge cost and schedule are adequate estimates that reflect the scope, 
objectives and requirements. 

Phase 2 portfolio has sufficient reserves, addressing both known and unknown risks 
Center evaluations of ability to execute Phase 2 Portfolio 

• Decision the Project is seeking today 

- Approval to proceed with baseline plan 
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Backup Slides 


Success Criteria Index 



KDP/Baseline Review Process 
Success Criteria 

Reference Charts 

TC-SAA 

TC-C2 

TC-HSI 

TC-ITE 

TWP needs, objectives, success criteria, requirements, and 
deliverables support Project Goals and are feasible, 
executable and balanced with resource and schedule 
constraints. Requirements are clearly tied to objectives. 

KDP 

KDP 

KDP 

KDP 

BU: 102-104 

BU: 110-112 

BU: 116-117 

25-33 

BU: 105-108 

BU: 113-114 

BU: 118-119 

34-35, 37 

10, Project Requirements Document (PRD) 

Implementers, customers, and key stakeholders support the 
plan. 

42, BU: 103-104 

44, BU: 111-112 

46, BU: 117 

31-33, 36 

KDP, 65-66 

Needs, objectives, deliverables and requirements are ready 
to be baselined and placed under change management. 

BU: 103-104 

BU: 111-112 

BU: 117 

31-33 

7-22, PRD 

TWP cost and schedule are adequate estimates that reflect 
the scope, objectives and requirements. TWP cost 
estimates have been independently assessed. 

BU: 106-108 

BU: 113-114 

BU: 118-119 

34-35, 37 

KDP, 22 

Recommended Phase 2 portfolio has sufficient reserves, 
addressing both known and unknown risks. 

BU: 108-109 

BU: 114-115 

BU: 119-120 

37-39 

47, 56, 

BU: 130 

Key risks and associated mitigations have been identified 
and are realistic/appropriate. 

BU: 109 

BU: 115 

BU: 120 

38-39, BU: 89-97 

57-58, BU: 98-101, 133-149 

Detailed execution plans are feasible; processes are in place 
to manage the baselines and risk. 

56, 62-69, BU: 151-160 

The team is adequately staffed with the "right" skill mix and 
understands the importance of the success and 
cost/schedule adherence. 

KDP, BU: 76 

The proposed UAS-NAS Phase 2 Plan is executable within 
budget and schedule. 

BU: 105-108 

BU: 113-114 

BU: 118-119 

34-35,37 

56 


KDP = Information was presented at KDP, BU = Backup Slides 
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UAS Integration in the NAS 
Organizational Structure 



Host Center Program Office 



Phase 2 Baseline Development 
Backup Slides 




Baseline Review Overview Schedule 



Sept 


Oct 


1 Oct - Tasks 


Nov 


to Centers 


Dec 


Jan 


Feb 


Mar 


Apr May 


10 Sep 

KDP 

Authority to 
proceed to 
Phase 2 




Ph 

ase 2 Executic 

)n 



1 

TWP/Tech C 

ontent Basel! 

ne 


^ 4 Feb 
▼KDP Follo\ 

v-on 


^ 8ll 


12 

TWP Re-examin 


♦ 

23-24 Sep 

Phase 2 
Kick Off 
Meeting 


Schedule Baseline 




Risks Basel i 


5 No 
Risk 
Worksho 


•19-21 

Risk 

Workshi: 


17 Dec 

Risk Review Meeting 

Road maps & Process Indicator^ (PI) 

16 Jan^ 

Initial Roadmap 


8 May 
MRB 
Approval 



Activiti as & 
Dependencies 


Process & Document Updates 


28 Feb 
Milestones 
Defined 


&PI 


ISRP 
Review PI 


8 May 
MRB 

Approval 
inal 

Roadmap & PI 

8 May 



ARD Coordination Meet 


13 

GFl 


9 Jan 

Examine existing 
processes 


Project 

Processes 


4 Apr 
Draft P2 
Project P Ian 


23 Apr* 
Draft 
PRD 



M4 Nov 
C Visit 


LaRC Visit 


11 Feb 
ARC Visit 


AFRC Visit 


22 Apr 
H<i»st Center 
’re-Brief 


1 May Approval 
Draft 
SEMP 
23 Apr 
Brief Final 
Budget Allocations 


^ 'IB May 
May Baseiine 
I3RP Review 
Pre -Brief 



IMS Decomposition 


Technical Challenges (TC) 


Defined through 
KDP process 

LI Milestones 
defined to 
document essential 
DAS Integration 
Milestones 

Progress Indicators 
comprised of L2 
milestones and 
reflect technical 
progress towards LI 
milestones 


Technical Work Packages (TWP) 


Schedule Packages (SP) 


Defined through 
KDP process 

Systematic grouping 
of related Schedule 
Packages 


Schedule Package 


Schedule Packages 
represent discrete 
bodies of scope and 
are the lowest fixed 
level in the IMS 

L2 Milestones as 
Execution and 
Reports 

Contain a 
framework for the 
phases of an activity 
(see below) 



Tasks 


All activities within a 
Schedule Package ^ 
necessary to 
complete the scope 
of the Schedule 
Package 

Milestones and 
Deliverables are at 
the task level 

Every task has an 
Unique ID 


Plan ^ Provision ^ Execute ^ 

> > > 


Analyze^ Report 
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Phase 2 Technical Challenges 



SAA Performance Standards 

- Provide research findings to develop and validate LIAS Minimum Operational 
Performance Standards (MOPS) for sense and avoid (SAA) performance and 
interoperability. 

C2 Performance Standards 

- Provide research findings to develop and validate LIAS Minimum Operational 
Performance Standards (MOPS) for terrestrial command and control (C2) 
communication. 

Human Systems Integration 

- Provide research findings to develop and validate human systems 
integration (HSI) ground control station (GCS) guidelines enabling 
implementation of the SAA and C2 performance standards. 

Integrated Test and Evaluation 

- Develop a relevant test environment for use in generating research findings 
to develop and validate HSI Guidelines, SAA and C2 MOPS with test 
scenarios supporting Integration of DAS into the NAS. 
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Baseline Content per Technical Challenge 

Backup Slides 



IHITL Configuration 1 

NASA Ames and NASA Armstrong Connectivity 



Part Task Simulation 4 (PT4) 

• Evaluated multiple displays and UAS pilot maneuver guidance 
concepts for self separation and collision avoidance 

• Data collection completed 3/18/14 

• Defined scenarios and selection of VSCS for further evaluation in IHITL 

IHITL Configuration 1 

• Test Set-up 1: Evaluate and measure the acceptability of SAA 
equipped UAS to ATC operations. 

• Test Set-up 2: Evaluate and measure the effectiveness and 
acceptability of the SAA algorithm and pilot maneuver guidance 
display to inform and advise UAS pilots of proximal traffic to maintain 
well clear. 


Test Setup (same as PT 4) 

• SAA Algorithm - Autoresolver 

• Displays - VSCS Integrated Traffic Display 




ZOA (Oakland Center) airspace encounter scenario 
with UAS conducting a coastal watch mission 


UAS Simulator and GCS Virtual Traffic Generation 


Scenario (same as PT 4) 

• Class E airspace operations, transition to/from Class A airspace 

• Single UAV 

• Multiple encounter geometries 


Changes from PT 4 

• Distributed test environment with AFRC 

• Increasing simulation fidelity 

• Test Set-up 2: ATC Subjects 

- Non-cooperative VFR traffic encounters 

• Research GCS 

• Eye Tracker instrumentation 


Test Duration (June - July 2014) 

• Test Set-up 1: ATC - 3 weeks 
(15 Controllers) 

• Test Set-up 2: UAS pilots - 2 
weeks (10 pilots) 



Ames - Armstron 


Test'En viip n m e nt 
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IHITL Configuration 2 

NASA Ames and NASA Langley Connectivity 


UAS CAS 1 

• Evaluated the effect of simulated SAA-equipped UAS on ATC acceptability 
and workload with differing horizontal spacing parameters used in the 
SAA algorithm 

• Data collection completed 3/21/14 

• Defined well clear distances to be evaluated in IHTIL 

IHITL Configuration 2 

• Conduct a HITL experiment to assess SAA-TCAS interoperability and the 
impact of communication delay on the execution of self-separation tasks. 

• Are the range of SAA SS maneuvers identified in the UAS CAS 1 experiment's 
simulation scenarios with no C2 delays acceptable by ATC, acceptable under 
realistic C2 conditions? 

• Are the TCAS interoperability design requirements still maintained under 
these delays and in simulated winds? 



ZFW (Dallas-Ft Worth) Airspace near Collin Cty 
Regional / McKinney Airport - head-on encounter 

scenario 


• Do C2 delays affect controller perceptions of unsafe conditions? 

Test Setup (same as UAS CAS 1) 

• SAA Algorithm - Stratway+ 

• Displays - MACS GCS engineering displays ^ 


UAS Simulator and GCS 
Virtual Traffic Generation 


Time) 


(TCAS Tau Boundary)/ 


Scenario (same as UAS CAS 1) 

• Class E airspace operations in proximity to Class B airspace 

• Single UAS 

• Multiple encounter geometries 


Changes from UAS CAS 1 

• Distributed test environment 

• Increasing simulation fidelity 

• C2 delays 

• 747 piloted simulator with TCAS II system 


Test Duration (June 2014) 

• Test Set-up 3: ATC - 3 weeks 
(6 Controllers) 



Ames - Langley DisfriiEubi^est Environment 


747 Simulator with TCAS II 
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Live Ownship 


Flightiest Series 3 




Honeywell King Air 





Multi-Aircraft Control 
System 


36 flights and 2 backups (3.5 hr flights) 
June - Aug 2015 


AFRCIkhana 


• ADS-B 

• TCAS II Instm 

• High speed 


ADS-B Out 


Live Intruder 

• ADS-B 

• Several options 

• NASA King Air 

• NASA T-34C 


Virtual/ Constructive 
Intruders 




Research GCS 
VSCS 


Stratway+ 


Autoresolver 


Displays of Proximal Traffic 
SAA/DAA Algorithms 
Pilot Maneuver Guidance 


Distributed 

Environment/Connectivity 


ATC as Subject 


Pseudo Pi bts 


Ikhana Data Link 

- C2 

- Voice 

- Health & Status 

- Video 

- Traffic (ADS-B 
and Radar) stratway+ 


ij 

Ikhana GCS 

- Stratway+ 

- Autoresolver 


s 

Autoresolver 


CNPC 
Data Link 

- C2 

- Voice 

Health & Status 

- Video 

- Traffic (ADS-B) 


UAS Pilot as Subject 









Live Ownship 


Flightiest Series 4 



») 



ADS-B Out 




Remote 

CNPCGCS 






Multi-Aircraft Control 
System 


AFRCIkhana 


Honeywell King Air 

• ADS-B 

• TCAS II Instm 

• High speed 


GRCS-3B 

• ADS-B 

• 2nd CNPC 


Research GCS 
VSCS 


Stratway+ 


Autoresoiver 


Displays of Proximal Traffic 
SAA/DAA Algorithms 
Pilot Maneuver Guidance 


Distributed 

Environment/Connectivity 


36 flights and 2 backups (3.5 hr flights) 
Feb -Apr 2016 


ADS-B Out 


Live Intruder 

• ADS-B 

• Several options 

• NASA King Air 

• NASA T-34C 


Virtual/ Constructive 
Intruders 






ATC as Subject 


Pseudo Pilots 


Ikhana Data Link 

- C2 

- Voice 

- Health & Status 

- Video 

- Traffic (ADS-B 

and Radar) stratway+ 


Ikhana GCS 

- Stratway+ 

- Autoresoiver 


Autoresoiver 


CNPC 
Data Link 

- C2 

- Voice 

Health & Status 

- Video 

- Traffic (ADS-B) 


UAS Pilot as Subject 








TC-ITE: Flight Test Series 3 & 4 


The Flight Test Series 3 in an operational but 
controlled environment, demonstrates systems 
integration and evaluation of UAS concepts 
and supporting technologies defined within 
the scope of the UAS in the NAS Project 

- SSI Algorithms and Sensor Models 

- C2CNPC 

- HSI Displays and RGCS 

Verify Sense and Avoid sensitivity, pilot 
workload, and maneuver negotiation under 
live flight uncertainties and the integrated 
prototype Control and Non-Payload 
Communication system 

36 flights and 2 backups (3.5 hr flights) 


NASA Flight Test 3 Goals: 

• Conduct integrated flight test series to verify Preliminary 
DAA and C2 MOPS 

• Demonstrate Live, Virtual, Constructive (LVC) distributed 
test environment 

• Demonstrate System integration of Surrogate UAS, RGCS, 
and SS Algorithms 

• Demonstrate Pilot Guidance Maneuvers through real 
world SS scenarios 

• Validate Sensor Models 



iiiiSk 


The Flight Test Series 4 in an operational but 
controlled environment, increases the complexity 
of FT3 and demonstrates systems integration and 
evaluation of the state of UAS concepts and 
supporting technologies 

- SSI Controller acceptability of DAA concept 

- C2 CNPC on two aircraft 

- HSI Displays secondary conflicts, traffic density, 
and weather 

Validate Sense and Avoid sensitivity, pilot 
workload, and maneuver negotiation under live 
flight uncertainties and the integrated prototype 
Control and Non-Payload Communication system 

36 flights and 2 backups (3.5 hr flights) 


NASA Flight Test 4 Goals: 

• Conduct integrated flight test series 4 to verify and validate 
Final DAA and C2 MOPS 

• Demonstrate Live, Virtual, Constructive (LVC) distributed 
test environment 

• Demonstrate Challenging encounter geometries with 2 or 
more live aircraft 

• Demonstrate Negotiation with UAS pilot and ATC in 
complex/busy airspace 

• Demonstrate two aircraft w/CNPC to assess link 
performance within the same spectrum 

• Demonstrate CA/SS Interoperability g 2 



TC-SAA: Overview 




Description: Determine the required performance of candidate SS and CA algorithms, SAA surveillance 
system requirements, performance characteristics of and interactions between SAA sub-functions. Also 
support definition of sensor and algorithm-agnostic maneuverability requirements and evaluation of the 
impact of sensor uncertainties and vehicle performance limitations on the execution of SAA maneuvers. 


r ^ 

Objectives 

L J 


Approach 


r ^ 

Deliverables 


• Recommend a set of minimum 
performance standards for sense 
and avoid systems and their sub- 
functions to meet a community- 
defined overall target performance 
level. 

• To substantiate the development of 
DAA MOPS, document assessment 
and recommendations of: 

• DAS performance and 
encounter geometry on DAA 
requirements impacts. 

• Degraded surveillance data 
resulting from sensor 
uncertainties/performance, at 
the SAA algorithm and 
concept/procedures level 
impacts. 


• Create new modeling and simulation 
capabilities in Airspace Concept 
Evaluation System (ACES) and perform 
a series of fast-time simulations with 
ACES. 

• Participate in IHITLto obtain human 
performance metrics SS maneuvers 
recommended by SAA system. 

• Participate in Flight Tests to validate: 
sensor models and requirements, 
trajectory prediction performance and 
SS and/or CA avoidance maneuver 
effectiveness. 

• Conduct batch simulations to evaluate 
specific maneuver algorithms 

• Conduct HITL evaluation of SAA 
algorithms and pilot guidance 
procedures. 


• DAS performance models & 
scenarios. 

• Fast-time SAA testbed (ACES). 

• Evaluations of definitions of 
well clear and 

recommendations on which to 
employ. 

• Description of the concept of 
operations for SAA. 

• Data, results, and technical 
reports from analysis, studies, 
batch simulations, HITLs, IHITL, 
and flight tests. 

• SAA requirements and 
recommendations for DAA 
MOPS. 

83 






TC-SAA: High Level Summary (1 of 2) 



ID 

Schedule Package Title 

Approach 

Deliverable 

MS 

S.1.10 

Surveillance Requirements (Low Fidelity) 

ACES Sim 

Brief (SC) 

L2 

S.1.20 

Surveillance Requirements (Medium Fidelity) 

ACES Sim 

Brief (SC) 

L2 

S.1.30 

Sub-function Tradeoffs w/ DAS Performance 

ACES Sim 

Brief (SC) 

L2 

S.1.40 

Interoperability of SS and CA Functions 

ACES Sim 

Brief (SC) 

L2 

S.2.10 

SAA Traffic Display Evaluation HITLl 

HITL 

Report 

L2 

S.2.20 

IHITL Participation & Data Collection SSI ARC IHITL 

HITL 

Report 

L2 

S.2.30 

Self-Separation Risk Ratio Study 

ACES Sim 

Report 

L2 

S.2.40 

FT3 Participation & Data Collection SSI ARC FT3 

Flight Test 

Report 

L2 

S.2.50 

FT4 Participation & Data Collection SSI ARC FT4 

Flight Test 

Report 

L2 

S.2.60 

SAA Traffic Display Evaluation HITL2 

ACES Sim 

Report 

L2 

S.2.70 

Effect of SAA Maneuvers with Procedures 

ACES Sim 

Report 

L2 

S.2.80 

Comprehensive Evaluation of Airspace Risk Threshold 
SSI ARC 

ACES Sim 

Report 

L2 

S.3.10 

Well Clear Metric and Definition Study 

ACES Sim 

Report 

L2 


Stakeholder Legend: 

C=TC-C2 

S=SARP 

F=FAA 

W=WRC 

SC=SC-228 

Project 
“ Office 


SPs contribute to SC-228 Preliminary and Final MOPS LI Milestones 
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TC-SAA: High Level Summary (2 of 2) 



ID 

Schedule Package Title 

Approach 

Deliverable 

MS 

S.3.20 

Well Clear Alerts/Resolutions 

ACES Sim 

Report 

L2 

S.4.10 

DAS - SAA Trade-off Assessments 

Batch Sim 

Report 

L2 

S.4.20 

CA/SS Algorithm Maneuvers vs. DA Performance 
Assessment 

Batch Sim 

Report 

L2 

S.5.10 

UAS CASl HITL 

HITL 

Brief (SC, S) 

L2 

S.5.20 

Langley Support & Participation in IHITL 

HITL 

Brief (SC) 

L2 

S.5.30 

Comm Gen2 Flight Test SSI Data Report 

Flight Test 

Report 

L2 

S.5.40 

SSI LaRC Support & Participation in FT3 

Flight Test 

Brief (SC) 

L2 

S.5.50 

SSI LaRC Support & Participation in FT4 

Flight Test 

Report 

L2 

S.5.60 

Alerting Times + CA-SS Integration Combined HITL 

HITL 

Brief (SC) 

L2 

S.6.10 

SAA Initial Flight Test Participation w/ IT&E 

Flight Test 

Conference 

Paper 

L2 

S.7.10 

Sensor Model Stress Testing & Sensitivity Analysis HITL 

HITL 

Brief (SC) 

L2 


• SPs contribute to SC-228 Preliminary and Final MOPS LI Milestones 


Stakeholder Legend: 

C=TC-C2 

S=SARP 

F=FAA 

W=WRC 

SC=SC-228 

Project 
“ Office 
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TC-SAA: SP S.1.30 Example 


Task 

FY2014 

FY2015 

FY2016 

qi 

Q2 

Q3 

Q4 

qi 

q2 

q3 

q4 

qi 

q2 

q3 

q4 

[SP S.1.30] Interoperability of SS and CA Functions {ACES Simulation] 








j 






Generation of Potential experiments examining the effectiveness of algorithms 









— 





First phase assessment 














Select preliminarY experiment scenarios 









1 





Algorithm refinements 










■ 




Experiment Revievi/ 










1 




PreliminarY collection 










- 




Second phase assessment 














Refinement of experiment focus and objectives 














Algorithm refinements 














Data Collection 












1 


Project Data Review 












1 


Fast-Time Assessment Results 














Write and submit Abstract for Conference 










1 

1 



Write up ACES Simulation Results 












<7 


ARC Publication Process 











■ 


















APG/API ^ LI Program (ISRP) ^ L2 Project 



TC-SAA: Schedule 




"it APG/API ^ LI Program (ISRP) ^ L2 Project 
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APG/API 


LI Program (ISRP) L2 Project 


88 






TC-SAA: Risk Matrix and Summary 


Risk Matrix 



CONSEQUENCE 


Med 


L X C Trend 

Decreasing (Improving) 
Increasing (Worsening) 
Unchanged 

(T) Indicates a Top Risk 


Approach 

A- Accept RA - Raise 
M - Mitigate E - Elevate 
W- Watch C- Close 
R- Research 



Risk ID 

Trend 

LxC 

Approach 

Risk Title 

4.1.7 

IZ> 

3x3 

M 

Lack of Collision Avoidance 
Model Availability and 
Integration Support 

V 

4.1.8 

(T) 

■=> 

3x3 

M 

Sense and Avoid Sensor 
Suite Availability 

4.1.9 

(T) 


3x3 

M 

Delay of SAA/SSI Technology 
Developments Impact to 
Integrated Test Events (IHITL, 
FT3 and FT4) 

4.1.10 

H> 

3x3 

M 

Completion of SAA/SSI 
Technical Objectives that 
Rely upon Formal 
Partnerships 


4.1.4 

■=> 

2x3 

M 

A test bed for airborne sense 
and avoid flight tests 
equipped with the command 
and non-payload 
communications radio may 
not be available 

4.1.5 

■=> 

2x3 

M 

Availability of unassociated 
and uncooperative aircraft 
track data 89 






TC2: C2 Performance Standards Overview 




Description: Develop and flight test a prototype terrestrial CNPC system to develop and validate 
performance requirements. Also conduct analysis and propose CNPC security recommendations for civil 
DAS operations and perform DAS Spectrum analysis and testing. Additionally, develop a simulation 
environment to perform analysis of a DAS CNPC system and validate the simulation. 


Objectives 


• Develop and validate a candidate 
UAS control and non-payload 
communication (CNPC) system 
prototype which complies with 
proposed international/national 
regulations, standards, and 
practices. 

• Perform analysis and propose CNPC 
security recommendations for civil 
UAS operations. 

• Develop data and rationale to 
obtain appropriate frequency 
spectrum allocations to enable the 
safe and efficient operation of UAS 
in the NAS. 

• Perform analysis to support 
recommendations for integration of 
CNPC and ATC communications to 
ensure safe and efficient operation 
of UAS in the NAS 


Approach 


• Develop and validate candidate UAS 
CNPC system prototype using RTCA SC- 
203 WG-2 proposed performance 
requirements in a relevant integrated 
test environment and mixed traffic 
environment. 

• Provide information on UAS CNPC 
development on an on-going basis to 
maintain/finalize the technical 
parameters of the UAS LOS CNPC 
allocation and support ensuring 
standards developments. 

• Develop control communication system 
link models that predict performance; 
validate during flight test. 

• Verify the performance of a secure 
terrestrial CNPC System, while 
interfaced to SAA and HSI components; 
validate during flight test. 


Deliverables 


• Results from CNPC System 
prototype performance in 
Relevant Environment and 
mixed traffic environment. 

• Analysis, test results, and 
recommendations of CNPC 
security architecture 
performance. 

• Propagation environment 
channel models for terrestrial 
CNPC spectrum bands. 

• NAS-wide UAS LOS CNPC 
system simulation results of 
Interim (low-medium fidelity) 
and CNPC link (high fidelity) 
communications models. 

• ATC and CNPC communications 
performance impact on 
delays/capacity of the NAS 
report and models. 
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TC-C2: High Level Summary (1 of 2) 



ID 

Schedule Package Title 

Approach 

Deliverable 

MS 

C.1.10 

Gen2 Radio in Relevant Environment Flightiest 

Flightiest 

Report 

L2 

C.1.20 

Verify Prototype Performance 

Flightiest 

Report (SC) 

L2 

C.1.30 

Verify Prototype Performance/Compliance ITU-R 
Prototype Comm System - Mixed Traffic Environment 
Flight Test 2 

Flight Test 

Report (SC) 

L2 

C.2.10 

Develop and Test Prototype Communication Security 
Test 

Lab Test 

Report (SC) 

L2 

C.2.20 

Performance Validation of Security Mitigations/ 
Relevant Flight Environment Security Mitigations 

Flight Test 

Report (SC) 

L2 

C.3.10 

Spectrum Compatibility Analysis Final Report and 
Recommendations on WRC-2015 

Analysis 

Report (SC, W) 

L2 

C.3.20 

C-Band Planning & Standards Final Report 

Analysis 

Report (SC, W) 

L2 


• SPs contribute to SC-228 Preliminary and Final MOPS LI Milestones 


Stakeholder Legend: 

C=TC-C2 

S=SARP 

F=FAA 

W=WRC 

SC=SC-228 

Project 
“ Office 
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TC-C2: High Level Summary (2 of 2) 



ID 

Schedule Package Title 

Approach 

Deliverable 

MS 

C.4.10 

Flightiest Radio Model Development and Regional 
Simulation - Inputs to Standards 

Simulation 

Report (SC) 

L2 

C.4.20 

ACES Sim Operations w/ Flightiest Models w/Genl 

ACES 

Simulation 

Report (SC) 

L2 

C.4.20 

ACES Sim Operations w/ Flightiest Models w/Gen2 

ACES 

Simulation 

Report (SC) 

L2 

C.4.20 

Large-scale Sims with Gen3 Radio Model 

ACES 

Simulation 

Report (SC) 

L2 

C.4.30 

Recommendations for Integration of CNPC and ATC 
Comm Final Start Execution 

Simulation 

Report (SC) 

L2 

C.4.40 

ATC and CNPC Comm Performance Impact on NAS 
Delay/Capacity 

Simulation 

Report (SC) 

L2 

C.4.50 

SatCom for UAS Simulation 

Simulation 

Report (SC) 

L2 


• SPs contribute to SC-228 Preliminary and Final MOPS LI Milestones 


Stakeholder Legend: 


C=TC-C2 


S=SARP 


W=WRC 


PO = 


Project 

Office 


F=FAA 

SC=SC-228 
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TC-C2: Schedule 




"it APG/API 



LI Program (ISRP) 



L2 Project 
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TC-C2: Risk Matrix and Summary 



Risk ID 

Trend 

LxC 

Approach 

Risk Title 

4.3.2 


3x4 

M 

Communication Security 
Requirements Exceed 
CNPC Link Bandwidth 
Constraints 

4.3.3 

(T) 


3x3 

M 

Key CNPC Equipment or 
System Failure 

4.3.5 


3x3 

M 

Additional Spectrum 
Analysis Requirements 

4.3.4 


2x4 

M 

Availability of OPNET 
Modeler Expertise 

4.3.8 


2x3 

M 

Radios flight tested in FT3 
and FT4 Series may 
not fully validate MOPS 

4.3.6 



W 

Higher Communications 
Aircraft Fuel Cost 



High 


Med 


Low 


L X C Trend 

XL Decreasing (Improving) 
Increasing (Worsening) 
Unchanged 

(T) Indicates a Top Risk 


Approach 

A- Accept RA - Raise 
M - Mitigate E - Elevate 
W- Watch C- Close 
R- Research 
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TC-HSI: Human Systems Integration 
Overview 

Description: Develop human factors guidelines including displays, controls, and procedures for operation 
in the NAS. The overall GCS guidelines will be comprehensive, but will have a specific focus on guidelines 
for SAA and C2 MOPS. Develop an instantiation of a prototype GCS for use in subproject and integrated 
testing events. 




r ^ 

Objectives 

^ 


Approach 


Deliverables 


• Develop a prototype GCS that will 
instantiate the GCS guidelines and 
serve as GCS for the integrated 
events. 

• Develop guidelines for GCS design 
and operation in the NAS. 

• Apply GCS guidelines towards DAA 
and C2 MOPS 


• Conduct simulations, flight tests, and 
community based review to address higher 
priority issues as assessed by the Project, 
FAA, JPDO, and community workshops. 

• Perform Part Task Simulations to focus on 
Contingency Management, SAA Displays, 
and Measured Response; results will feed 
into the Prototype GCS (PGCS). 

• Perform Full Mission Simulations to address 
pilot's ability to respond quickly when 
operating in various levels of automation; 
results will feed into the PGCS. 

• Perform information requirements analyses 
based on: regulation (FARs), phase of flight, 
and pilot functions. 

• Work with community based organizations 
to identify key elements and develop 
recommendations for guidelines. 


• PGCS 

• Multiple technical reports on 
findings from specific 
experiments. 

• Human Factors (HF) 
Guidelines for SAA, C2, and 
GCS. 
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TC-HSI: High Level Summary 




ID 

Schedule Package Title 

Approach 

Deliverable 

MS 

H.1.10 

IHITL results HSI 

HITL 

Briefing (SC) 

L2 

H.1.20 

Measured Response Simulation C 

Simulation 

Briefing (F) 

L2 

H.1.30 

Compliant Ground Station Full-mission Simulation 1 

Full Mission 
Simulation 

Briefing (SC, S) 

L2 

H.1.40 

NAS Compliant Ground Station 
Part-Task Simulation 4: SAA Pilot Guidance 

Part Task 
Simulation 

Briefing (SC, S) 

L2 

H.1.50 

HSI FT3 

Flight Test 

Briefing (SC) 

L2 

H.1.60 

HSI FT4 

Flight Test 

Briefing (SC) 

L2 

H.1.70 

NAS Compliant Ground Station 

Part-Task Simulation 5: SAA Pilot Guidance Follow-on 

Part Task 
Simulation 

Briefing (SC, S) 

L2 

H.1.80 

NAS Compliant Ground Station 
Full-mission Simulation 2 

Full Mission 
Simulation 

Briefing (SC, S) 

L2 

H.1.90 

Visual Requirements for Landing Analysis 

Simulation 

Report (C2) 

L2 

H.2.10 

GCS HF Draft Guidelines 

Analysis 

White Paper 

L2 

H.2.20 

GCS HF Draft Guidelines 

Analysis 

Report 

L2 

H.2.30 

GCS HF Final Guidelines 

Analysis 

Report 

L2 


• SPs contribute to SC-228 Preliminary and Final MOPS LI Milestones 


Stakeholder Legend: 
C=TC-C2 S=SARP 


F=FAA 

SC=SC-228 


W=WRC 


P0 = 


Project 

Office 
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'if APG/API 


A Ll Program (ISRP) ^ L2 Project 
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TC-HSI: Risk Matrix and Summary 



Risk ID 

Trend 

LxC 

Approach 

Risk Title 

4.2.8 

(T) 


3x3 

M 

Endorsement of HSI GCS 
Guidelines from a 
Recognized Standards- 
based Group 

4.2.10 


3x3 

M 

Completion of HSI Technical 
Objectives that Rely upon 
Formal Partnerships 

4.2.7 


2x3 

M 

Manned vs Unmanned HSI 
Measured Response Data 
Comparison 

4.2.9 

(T) 


2x2 

M 

Delay of HSI Technology 
Development Impact to 
Integrated Test Events 
(IHITU FT3 and FT4) 



High 


Med 


Low 


L X C Trend 

XL Decreasing (Improving) 
Increasing (Worsening) 
Unchanged 

(T) Indicates a Top Risk 


Approach 

A- Accept RA - Raise 
M - Mitigate E - Elevate 
W- Watch C- Close 
R- Research 
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UAS-NAS Project OV-1 




DAA Technologies 
Air Traffic Services 
CNPC Network 
Legacy C2 Links 


Communications 
Sateiiite ^ 


NAS Eiements 


Cooperative 

Aircraft 


p Detect 
and Avoid 


Command 
and Control 


T-34 UAS Surrogate 
CNPC Test Aircraft 


Non-cooperative 

Aircraft 


f IkhanaUAS 
SAA Test Aircraft 


SATCOM ^ 
Upiink 


CNPC 
Ground ^ 
Stations 


Air Traffic 
Services 
(Enroute) 


Human Systems 
Integration 


UAS 

Control 

Station 


Research 
Control 
I Station 


UAS Restricted 
Use Certification 


sUAS 

Operational 

Procedures 


Air Traffic 
Services 
(Terminal) 


Commercial UAS Operations 


Precision Agriculture 




TC-ITE: Integration Test & Evaluation 

Overview 




Description: Develop an integrated test environment to develop, test, and explore key challenges and 
technology objectives of the subprojects technology, developing concepts, technologies, and capabilities in 
evaluating the overall operation of UAS in the NAS in a relevant environment. And lead the subprojects in 
the test planning of the integrated test events. 


r ^ 

Objectives 

^ 


Approach 


Deliverables 


• Develop a Live Virtual 
Constructive (LVC) Distributed 
Test Environment to integrate 
and test subproject key 
technologies in a relevant 
environment. 

• Document the design, 
objectives, metrics, data 
collection, and assets for 
integrated test events. 

• Conduct the planning and 
execution of integrated test 
events: IHITL, FT3, and FT4. 


• Conduct systematic reviews 
of integrated test events and 
associated test planning to 
ensure readiness and ensure 
functional, physical and 
operational performance 
requirements meet the UAS- 
NAS Project objectives. 

• Define and test airspace and 
scenario files with 
researchers. 

• Execute and report on 
integrated test events . 


• Integrated design 
documents including: 
System Requirements, 
Interface Control 
Documents, Software 
Design Documents, 
Subsystem Verification & 
Validation Plans, Test Plans, 
and system characterization 
for each integrated events 

• Airspace and scenario 
definitions, flight plans and 
initial conditions for each of 
integrated event 

• Final Test Reports 
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Non-Technical Challenge Work 
Backup Slides 


Support of NASA Agreement with USMC 


Reference: Interagency Agreement between NASA and US Marine Corps (USMC) 
Unmanned Aerial Vehicle Squadron 2 (VMU 2) 

Purpose: 

- Conduct cooperative research for UAS-related activities including flight-testing, 
simulation and modeling, and pilot surveys in support of the UAS-NAS and VMU 

Background: 

- Agreement signed off on 7 March 2014 

- Initial survey conducted by LaRC HSI personnel in FY13 

- Plan at KDP was to complete task in Quarter of FY14 

• Due to furlough, delayed and then canceled initial survey and completion of task 

Current Task: HSI Subproject Project Engineer is coordinating this task with a not to 
exceed cost and no impact to existing work - Now working with VMU 1 & 3 also 

- Observations and evaluations of his current system and operations 

- Workflow analysis of current system and operations 

• Capture workflow 

• Identify human bottlenecks, areas for improvement 

• Identify system bottlenecks, areas for improvement 

• Leverage existing technologies/systems as well as emerging technologies to improve workload 

- Heuristic evaluation of their existing system 

- Application recommendations 


Far Reaching/High Risk -- Core 


Need a LIAS design and operational 
CONORS that are feasible to assess 
from a certification perspective - so 
that we have a realistic core basis for 
airworthiness certification 

- can't be too far reaching 

- but beyond what has been certified 
or is pending for certification today 

Considering risk/challenge in making 
LIAS platform and operations decisions 

- rotary wing vs. fixed wing 

- weight range/capability beyond 
RMAX 

- beyond line of sight capability 

- precision aerial application vs. aerial 
survey 

• shifting weight and chemical issues 

• not necessarily patterned 



Benefit: realistic set of airworthiness 
standards for commercial UAS ops 




Cert Risk Matrix and Summary 



Risk ID 

Trend 

LxC 

Approach 

4.4.6 


3x3 

M 

4.4.5 


2x3 

M 



Risk Title 


Completion of Certification 
Technical Objectives that 
Rely upon Formal 
Partnerships 

Availability of Designated 
Engineering Representatives 
Resources 



L X C Trend 

J3^ Decreasing (Improving) 
Increasing (Worsening) 
Unchanged 

(T) Indicates a Top Risk 


Approach 

A- Accept RA - Raise 
M - Mitigate E - Elevate 
W- Watch C- Close 
R- Research 
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sUAS-Autonomy Far-Reaching Ideas 



• Ideas stem from what is required to ultimately achieve a sUAS self-aviating 
system capable of unattended 24/7 operation beyond visual line of site in 
urban and rural areas in the NAS 


- Primary areas of focus are: Mission, Environment, Awareness, and Interaction 


• Ideas generated from efforts conducted through/by C-UAS, NASA, and 
academia. 


Mission 


Environment 


Awareness 


Interaction 


• Fire perimeter mapping 
STTR (SSCI/MIT) 


Multi-sensor SLAM 
(C-UAS, Drexel, MIT) 


• Fire detection via RETINEX 

• Soil Moisture mapping (Aero 
Academy, VT) 

• Payload directed flight 
(Ames) 

• Storm Damage Assessment 
(NOAA/NWS/VT/LaRC) 

• Autolocation of survivors 
(JSC, MSEC) 


Multi-sensor fusion 
(LaRC) 

Sense-and-Avoid (C- 
UAS, LaRC, others) 

Small UAS sensor 
SWAP and 
requirements 
definition (C-UAS, 
LaRC, WFF) 


• Own Ship Health 
monitoring & 
prognostics 
(Ames/LaRC) 

• Heuristic flight 
control recovery 
(NASA, Aurora, 
others) 

• Adaptive response 
to environment 
(Seedling) 

• Auto recharge, 
refuel & repair 


Minimizing 
operator workload 
(C-UAS) 

Airspace 
Integration 
Autonomy (AOC) 
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Non Technical Challenges 



Non-Technical Challenge - Certification and Safety 

[TWP N.l] Certification 
[SP N.1.10] Case Study 
[SPN1.20] Analysis 

Non-Technical Challenge - Air Transportation System 

[TWP N.2] sUAS Support to Initial Rulemaking 
[SP N.2. 10] sUAS Testing 



FY2014 


FY2015 


Q1 

Q2 

Q3 

Q4 

Q1 

Q2 

Q3 

Q4 

Q1 

Q2 

Q3 

Q4 



1 










FY2016 



APG/API 


LI Program (ISRP) L2 Project 


106 




Project Summary 
Backup Slides 



[P1/P2] 

[P1/P2] 

[P1/P2] 

[P1/P2] 

[P1/P2] 

[P1/P2] 

[P1/P2] 

[P2] 


Grants and Agreements - Current 


Grant with University of South Carolina, "Unmanned Aircraft Systems (UAS) Research: The Air 
to Ground Channel, Robust Waveforms, and Aeronautical Network Simulations" 

Space Act Agreement between NASA Glenn and the Federal Aviation Administration: Research 
for Aviation Communications/Navigation/ Surveillance/ Information Systems 

Interagency Agreement between the Federal Aviation Administration and the National 
Aeronautics and Space Administration: Unmanned Aircraft Systems Research and Technology 
Development 

Interagency Agreement between MIT Lincoln Labs and the National Aeronautics and Space 
Administration: Integration of ACAS-UA into NASA Airspace Simulations 

Cooperative Agreement with California State University Long Beach: Human Systems 
Integration - Measured Response 

Cooperative Agreement with Rockwell Collins, for the development of Control and Non- 
Payload Communication System Radio prototypes. 

Membership with the Center for Unmanned Systems (C-UAS). It is a National Science 
Foundation (NSF) sponsored research consortium, where the members are able to vote on 
what projects the center conducts. 

Space Act Agreement with University of North Dakota for Certification work - in work 



PI = Phase 1, P2 = Phase 2 


108 



Med 


Project Management Risk Matrix and Summary 


Risk Matrix 



CONSEQUENCE 


Lx CTrend 


Approach 


Decreasing (Improving) A- Accept RA - Raise 
Increasing (Worsening) M - Mitigate E- Elevate 
Unchanged 

(T) Indicates a Top Risk 


W- Watch C- Close 
R- Research 



Risk ID 

Trend 

LxC 

Approach 

Risk Title 

1.1.10 

(T) 

NEW 

3x4 

M 

Output from Test Events has 
value to Project Stakeholders 

1.1.13 

>=> 

3x4 

M 

Baseline Review Preparation 
Impacts to Milestones and 
other Project Tasks 

1.1.6 

>=> 

4x2 

M 

Collaboration with 
International Organizations 

1.1.7 

>=> 

3x3 

M 

Negative Public Perception 
of UAS Flying in the NAS 

ISRP 

02 

(T) 

>=> 

2x3 

M 

Project Focus Changes Due 
to External Influences 

1.1.4 

(T) 


2x3 

M 

The predicted or projected 
UAS mission profiles and 
traffic density estimates 
used by the subprojects for 
their technology 
development efforts may 
not be realistic or accurate 

ISRP 

05 

(T) 


1x3 

M 

Inability to Meet UAS-NAS 
KDP-2 (Phase 1-to Phase 2 
Transition) 









Risks Closed Since KDP 



Risk ID 

Project/ 

Subproject 

Risk Title 

Date 

Closed 

Closing Rationale 

1.1.8 

Project 

Management 

Comprehensive UAS 
Automation Roadmap 
(UAR) development 

2/25/14 

The JPDO has been defunded. The UAR work, including 
developing the ontology, may be captured under the FAA's 
NextGen organization. If the work is captured, it will have an 
internal FAA flavor which will not address the community needs 
identified during the Phase 2 KDP process. As such, the risk 
associated with the development of the UAR is no longer relevant 
to the Project. 

1.1.12 

Project 

Management 

Additional Workload due to 
supporting SARP Tasks 


TWPs and the SPs for PEs (specifically SSI East/West, HSI) have 
identified level or effort work to support SARP and work has been 
added to baseline plan. Davis Flackenberg is a member of the 
SARP Board. Flaving established a baseline with our work - SARP 
attendees (PE) taking on work outside scope of baseline would 
constitute new work which would require Project Office approval. 

4.1.6 

SSI 

Resources at Langley to 
support SSI activities 

2/19/14 

Risk has been fully mitigated. The necessary mitigation steps 
have been accomplished. Langley Center management has 
prioritized their hiring and staffing to fully staff this area at 
Langley. The SSI Team at Langley is now fully staffed to its 
designated FTE and WYE complements. 

5.1.2 

IT&E 

Connectivity requirements 
to external partners have 
not been defined 

12/17/13 

This risk is recommended for closure as its intent is captured in 
risks U.5.1.6, U.5.1.7, and U.5.1.8 that delineate lack of 
requirements definition for IFIITL, FT-3, and FT-4 respectively. The 
lack of defined requirements for the three integrated events are 
inclusive of external partner requirements and; therefore, makes 
U.5.1.2 duplicative. 
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Risks Closed Since KDP Cont. 



Risk ID 

Project/ 

Subproject 

Risk Title 

Date 

Closed 

Closing Rationale 

5.1.3 

IT&E 

The Live-Virtual- 
Constructive Distributed 
Environment (LVC-DE) 
infrastructure lacks a 
common voice 
communication system for 
the integrated human-in- 
the-loop simulation and 
flight test series 

12/17/13 

The IT&E team has developed a common voice communication 
architecture that meets the requirements for IHITL simulations 
and flight tests. Employing commercially available analog to 
digital converters, the Distributed Interactive Simulation (DIS) 
based VoIP system at Ames, and other NASA centers, will be 
interfaced to the analog voice system at Dryden that meet the 
requirements of the IHITL and flight test voice communications 
plan. The architecture requires procurement of some new 
equipment at Dryden within the available budget of IT&E. 

5.1.5 

IT&E 

Acceptance of the 
Distributed Test 
Environment as a Relevant 
Test Environment 
(Representative of the 
National Airspace System) 

5/8/14 

Project Management risk U. 1.1. 10 Output from Test Events has 
value to Project Stakeholders, captures the intent of this risk to 
get concurrence that the LVC test environment is relevant. 

5.1.6 

IT&E 

Distributed Test 
Environment requirements 
for Integrated Human in 
the Loop simulation (IHITL) 
not defined 

3/25/14 

Had final design review. Working to close out RFIs received last 
week. Mitigation 03 is complete, reducing the LxC to 1x3. Risk is 
trending down. Rationale for Closure: The IHITL Delta Final 
Design Review was conducted March 4-5. No RFI's were written 
to change or add requirements that increase scope. The 
requirements are considered complete. 

5.1.9 

IT&E 

Required assets for the 
Integrated Human in the 
Loop simulation (IHITL) not 
available during test period 

5/8/14 

Confirmation, that the distributed test environment architecture 
and required assets to successfully conduct IHITL simulations 
have been fully defined and baselined, was received from the PEs 
during an IHITL Config 1 Weekly Engineering Meeting (2 April) and 
during an IHITL TIM (4 April). 
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Risks Closed Since KDP Cont. 



Risk ID 

Project/ 

Subproject 

Risk Title 

Date 

Closed 

Closing Rationale 

5.1.12 

IT&E 

Unable to integrate 
required component or 
data feed from sub-projects 

9/17/13 

Risk combined into three existing risks (U.5.1.9, U. 5. 1.10, 
U. 5. 1.11) and can be closed. 

5.1.13 

IT&E 

Unable to integrate 
required component or 
data feed from external 
partners 

9/17/13 

Risk combined into three existing risks (U.5.1.9, U. 5. 1.10, 
U. 5. 1.11) and can be closed. 

5.1.14 

IT&E 

Unable to successfully 
integrate algorithm or 
display under test for IHITL 

12/17/13 

This risk is recommended for closure due to its being OBE. The 
risk was originally written to capture the lack of a common 
configuration for evaluating the SSI technologies for IHITL. As a 
result of the Project's decision to utilize the UAS-CASl test 
configuration for a portion of the IHITL, a common integration 
configuration is unnecessary at this time. 

5.1.15 

IT&E 

Inability to achieve TCAS II 
Self-separation IHITL 
Objectives due to lack of an 
IT Security Authority to 
Operate (ATO) 

5/8/14 

The MOU between NASA Ames Simlabs and NASA Langley SGT 
lab signatures were completed on 2 April 2014. The two 
laboratories have successfully connected and are testing the data 
flow in support of the IHITL on a weekly basis, leading up to the 
May V&V testing. 
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Risks added since KDP 



Risk ID 

Trend 

LxC 

Approach 

Risk Title 

Date 

Added 

1.1.10 

NEW 

3x4 

M 

Output from Test Events has value to Project Stakeholders 

5/8/14 

1.1.12 



C 

5/8/14 

Additional Workload due to supporting SARP Tasks 

1/21/14 

1.1.13 


3x4 

M 

Baseline Review Preparation Impacts to Milestones and other Project 
Tasks 

1/21/14 

4.1.9 

(T) 


3x3 

M 

Delay of SAA/SSI Technology Developments Impact to 
Integrated Test Events (IHITL, FT3 and FT4) 

1/21/14 

4.1.10 

>=> 

3x3 

M 

Completion of SAA/SSI Technical Objectives that Rely upon Formal 
Partnerships 

1/21/14 

4.3.8 


2x3 

M 

Radios flight tested in FT3 and FT4 Series may 
not fully validate MOPS 

1/21/14 

4.2.9 

(T) 

O 

2x2 

M 

Delay of HSI Technology Development Impact to 
Integrated Test Events (IHITL, FT3 and FT4) 

1/21/14 

4.2.10 


3x3 

M 

Completion of HSI Technical Objectives that Rely upon Formal 
Partnerships 

1/21/14 
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Risks added since KDP Cont. 



Risk ID 

Trend 

LxC 

Approach 

Risk Title 

Date 

Added 

5.1.15 

(T) 



C 

5/8/14 

Inability to achieve TCAS II Self-separation IHITL Objectives due to 
lack of an IT Security Authority to Operate (ATO) 

12/17/13 

5.1.16 


3x3 

M 

Completion of ITE Technical Objectives that Rely upon Formal 
Partnerships 

12/17/13 

5.1.17 

(T) 


1x3 

M 

The T-34 (UA Surrogate) for FT3 and FT4 may not be available 

12/17/13 

5.1.19 


4x3 

M 

Eyetracker System Not Installed in RGCS for IHITL 

3/25/14 

5.1.20 

(T) 

NEW 

3x4 

M 

Unsigned Agreement could delay flight test and result in the 
cancellation of SAA Initial Flight Tests 

5/8/14 

4.4.6 


3x3 

M 

Completion of Certification Technical Objectives that Rely 
upon Formal Partnerships 

2/28/14 
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Project Control Processes & Governing Documents 

Backup Slides 


Requirements 
Flow Down 



System Design 
Process 


Technical Management 

(note: follows 7123. IB SE Engine) 


Technical Management 
Process 


Product Realization 
Process 





© 


stakeholder 
Needs & 
Technical 
Challenges 


I 


UAS-NAS 

Project 

Requirements 

Document 

(PRD) 


I 


UAS-NAS 

TWP 

Solutions & 
Approaches 
(TWP & SP) 


Technology Transfer 
Plan 


Technical Control 
Processes 

Management of: 
Requirements, 
Schedule, 
Change, Risks, 
and Data 

UAS-NAS 
Project /TWP 
Analysis & 
Assessment 



UAS-NAS 

Formal 

Technology 

Transfer 


UAS-NAS 
Verification & 
Validation 


UAS-NAS 

Project 

Integration 

Activities 


© 


SE Processes leverage existing Project processes 

Schedule management, change management, risk management, and PE/TL Status at the UAS 
weekly telecon 

Technical management process is formally documented in the SEMP 




116 


Realized 

Products 


Resource Management 




Product Tool 


Benefit 





Business Warehouse (BW) 

FTE Report 


and SAP-NASA Accounting 



System) 


• FTE monthly by center and subproject 

• Allows for monthly analysis 
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Change Management Process 



Elements of Change Management 

Official Location/ 
Governing Document 

Related Documents 

Ll Milestones 

Program Plan 

Project Plan, IMS 

L2 Milestones 

L2 Milestone Document 

IMS 

Technical Challenges 

Program Plan 

Project Plan 

Technical Baseline 

(SP Objective, approach, deliverables) 

PRD 

Subproject Plans 

Project Requirements 

PRD 


Budget 

Program Plan 

Project Plan, Resource Spreadsheet 

Project Goals and Objectives 

Project Plan 


Note: Management Plans will fall under Change Management Process as well 


• The Project will also be managing documents with version control 

• Change management process is formally documented in the CMP 
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Continuous Risk Management (CRM) process 




Note: Communication and documentation extend throughout all functions. 

*Raise: unique to UAS-NAS Project 

119 








Project Reporting Samples 


Weekly 



Ripr«ertfcatfwe TC Tadt 

M/5 

Level 

Begki Date 

End Date 

Statut/Pmgrea /Concemi 

SchBdulB PBckagB N 




TechnicaL Schedule. 






AccmnplishniBnts, and Issues and 






ConcBrns Status 


Active-Taskl 



02/15714 1 

complete 


Active Task2 


wiunA 

02/2E/H 

ongoing 


Active Task? 


OlfOlflA 

03/31/14 1 

ongoing 


□eliverabiB 

□ 

03/15/M 1 

03/15/14 



Milestone 

l_Z 

OAfOlflA j 

04/01/14 



Bi-Weekly 


IHITLSim Coinplete/FY 14 API IHITL Assessment 


.'nil^niariQn iiZ^ □r'rCn'iijCcd'TIzi: 


Weekly 

- UAS-NAS Weekly Telecon PE/TL Status Reporting 

Bi-Weekly 

- UAS-NAS Detailed Status Reporting to ISRP 

Monthly 

- Progress Indicators 

- Monthly Report to ISRP 

- Management Review Board 

- Schedule Roadmap 

Bi-Monthly 

- Armstrong Center Management Council (CMC) 


tndir'^ 1^ tc rot! COCA 

!^c ricrpo^ r 


SH'dbd'a: on 


All 


U C Jtfna fct 'rd irAlLm 




cir'^r.t^jEr. 

■ Set LUSCAS: a-C ’a^Tdklim^'. 
wxk <zf 3/lT. AwMiri '^x£t«k''iei 
cta-iai 1T.ra-V-f^J=rnrf 

tae P=i.l:i. 


■l-n. ExrV- racier nxi, UAS OUl, 
i:tc uJH- bM: 
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Technical Roles and Responsibilities 



• The UAS-NAS CSE is the primary 
interface to the Project Manager for 
technical issues 

• CSE delegated authority to the IT&E 
Team to lead the development of the 
LVC-DE and lead the integrated test 
planning effort 

• CSE conducts oversight and insight 

- Oversight: CSE provide technical 
guidance and direction 

- Insight: Maintains knowledge and 
understanding of all subproject 
activities 



• CSE leverages each Center's internal system engineering processes and 
procedures, and reviews during the design, development, and 
implementation of Technical Challenge/subproject events and deliverables 
internal to that center 
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Engineering Review Team (ERT) Meeting 


CSE determines if a technical topic/issue 
requires an ERT 

CSE defines the objective of the ERT meeting 

ERT meeting scheduled with the appropriate 
personnel to resolve the technical topic/issue 

- Team members (CSE, PEs) discuss the topic/issue 

- Team members consider impacts, pro/cons, 
alternatives, technical approaches, etc 

- Technical decision path is developed 

• Ad hoc working groups may be assembled 




- Team members develop a recommended solution 

ERT decisions 

- Within cost, schedule, or scope, then CSE advises the team at the DAS Weekly 

• Example: LaRC Connectivity, solution did not impact cost, schedule, or scope 

- Impacts change controlled items cost, schedule, scope (technical content) submitted 
to MRB for approval 

• Example: sensor suite, SAA Initial Flight Tests 


MRB is the Project decisional board for final approval of recommendations by 
the ERT 


Version Control 



Definition 

- Project's informal process where the owners/authors will identify initial release 
and subsequent updates to project items for consistency in storage and 
distribution of the latest version of information 

Utilization 

- Will be utilized for documents not defined as an element of the CM Process per 
the Change Management Plan 

• Examples: Risk Slide Packages, Integrated Master Schedule (IMS), and Resource 
Spreadsheet 


Process 

- The document will be denoted with an appropriate title and document number 
that coincides with the document numbering system 

- An advisory slide will be presented at the Management Review Board (MRB) to 
address changes made via Version Control 


Minimum & Full Success Technical Challenge SPs 

Supports Project Descope Strategy 



Schedule 

Package 

PE Minimum/Full 
(M/F) Success 

T.1.02 

M 

T.1.03 

M 

T.1.10 

M 

T.1.20 

F 

T.2.10 

M 

T.2.20 

M 

T.2.30 

F 

T.2.40 

M 

T.2.50 

M 

T.2.60 

M 

T.4.10 

M 

T.4.20 

M 

T.4.30 

M 

T.4.40 

M 

T.4.50 

M 

T.4.60 

M 

T.5.10 

F 

T.5.20 

M 

T.5.30 

M 

T.5.40 

M 

T.5.50 

M 

T.5.60 

M 

T.5.70 

M 

T.3.10 

M 

T.3.20 

M 

T.3.30 

M 

T.3.40 

M 


Schedule 

Package 

PE Minimum/Full 
(M/F) Success 

S.6.10 

M 

S.7.10 

M 

C.1.10 

M 

C.1.20 

M 

C.1.30 

M 

C.2.10 

M 

C.2.20 

M 

C.3.10 

M 

C.3.20 

M 

C.4.10 

M 

C.4.20 

M 

C.4.30 

M 

C.4.40 

M 

C.4.50 

M 

H.1.10 

M 

H.1.20 

M 

H.1.30 

M 

H.1.40 

M 

H.1.50 

M 

H.1.60 

M 

H.1.70 

M 

H.1.80 

M 

H.1.90 

M 

H.2.10 

M 

H.2.20 

M 

H.2.30 

M 

T.1.01 

M 


Schedule 

Package 

PE Minimum/Full 
(M/F) Success 

S.l.lO 

M 

S.1.20 

M 

S.1.30 

F 

S.1.40 

F 

S.2.10 

M 

S.2.01 

M 

S.2.20 

M 

S.2.30 

M 

S.2.40 

M 

S.2.50 

M 

S.2.60 

F 

S.2.70 

M 

S.2.80 

F 

S.3.01 

M 

S.3.10 

M 

S.3.20 

F 

S.4.01 

M 

S.4.02 

M 

S.4.10 

M 

S.4.20 

M 

S.4.03 

M 

S.5.10 

M 

S.5.20 

M 

S.5.30 

M 

S.5.40 

M 

S.5.50 

M 

S.5.60 

M 


Governing Project Documents 



Controlled Documents 

Document Number 

Document 

Date 

Status 

Project Plan Phase 1 

UAS-PRO-l.l-OOl-003 

07-29-13 

Baselined 

Project Plan Phase 2 

[Includes Risk Management Process] 

UAS-PRO-1.1-004-001 

05-08-14 

Ready to Route 
for Signature 

Project Requirements Document (PRD) 

UAS-PRO-1.1-005-001 

05-08-14 

Signed 

Systems Engineering Management Plan 
(SEMP) 

UAS-PRO-1.1-007-001 

05-08-14 

Signed 

Change Management Plan (CMP) 

UAS-PRO-1.1-002-002 

05-08-14 

Signed 

Schedule Management Plan (SMP) 

UAS-PRO-1.1-008-001 

05-08-14 

Signed 

Technology Transfer Plan (TTP) 

UAS-PRO-1.1-006-001 

05-08-14 

Signed 

Records Retention Schedule 

UAS-PRO-1.1-003-003 

05-08-14 

Signed 

Public Outreach Plan 

UAS-OR-7.0-001-001 

05-08-14 

Signed 

SSI Subproject Implementation Plan 

UAS-SSI-4.1-001-001 

TBD 

Draft 

HSI Subproject Implementation Plan 

UAS-HSI-4.2-001-001 

TBD 

Draft 

Comm Subproject Implementation Plan 

UAS-COMM-4.3-001-001 

TBD 

Draft 

Cert Subproject Implementation Plan 

UAS-CERT-4.4-001-001 

TBD 

Draft 

IT&E Subproject Implementation Plan 

UAS-ITE-5.1-001-001 

TBD 

Draft 
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Acronyms 



AA 

Associate Administrator 

ACAS 

Airborne Collision Avoidance System 

ACES 

Airspace Concept Evaluation System 

ACMC 

Armstrong Center Management Council 

ADS-B 

Automatic Dependent Surveillance - Broadcast 

ADS-R 

Automatic Dependent Surveillance-Rebroadcast 

ADRS 

Aeronautical Datalinkand Radar Simulator 

AFRC 

Armstrong Flight Research Center 

AFRL 

Air Force Research Lab 

AFSRB 

Airworthiness and Flight Safety Review Board 

AOC 

Airspace Operations Challenge 

APG 

Annual Performance Goal 

API 

Annual Performance Indicator 

ARC 

Ames Research Center/Aviation Rule Making Committee 

ARD 

Aeronautics Research Director 

ARMD 

Aeronautics Research Mission Directorate 

ASTM 

American Society for Testing Materials 

ASP 

Airspace Systems Program 

ATC 

Air Traffic Controller 

ATO 

Authority to Operate 

ATS 

Air Traffic Services 

ATSI 

Air Transportation System Interoperability 
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Acronyms 



AUVSI 

Association for Unmanned Vehicle Systems International 

BIOS 

Beyond Line of Sight 

BOE 

Basis of Estimate 

BW 

Business Warehouse 

C2 

Command and Control Subproject 

CA 

Collision Avoidance 

CAS 

Controller Acceptability Case Study 

CCB 

Configuration Control Board 

CDR 

Critical Design Review 

CFR 

Code of Federal Regulations 

CM 

Change Management 

CMC 

Center Management Council 

CMP 

Change Management Plan 

CNPC 

Control and Non-Payload Communications 

CONOPS 

Concept Of Operations 

CONUS 

Continental United States 

CR 

Continuing Resolution/Change Request 

CRM 

Comment Resolution Matrix/Continuous Risk Management 

CSE 

Chief Systems Engineer 

CSUN 

California State University of Northridge 

CTD 

Concepts & Technology Demonstrations 
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Acronyms 



C-UAS 

Center for LIAS 

DAA 

Detect and Avoid 

DIS 

Distributed Interactive Simulation 

DPMf 

Deputy Project Manager for 

DRM 

Design Reference Mission 

EAFB 

Edwards Air Force Base 

EO/IR 

Electro Optical/Infra Red 

ExCom 

LIAS Executive Committee 

ERT 

Engineering Review Team 

FAA 

Federal Aviation Administration 

FAR 

Federal Aviation Regulation 

FDR 

Flight Design Review 

FRR 

Flight Readiness Review 

FT 

Flight Test 

FTE 

Full Time Equivalent 

FY 

Fiscal Year 

GBSAA 

Ground Based Sense and Avoid 

GCS 

Ground Control Station 

GDS 

Great Dismal Swamp 

GRC 

Glenn Research Center 

HF 

Human Factors 
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Acronyms 



HITL 

Human-ln-The-Loop 

HSI 

Human Systems Integration Subproject 

ICA 

Independent Cost Assesment 

ICAST 

Inter Center Autonomy Study Team 

ICD 

Interface Control Document 

IFR 

Instrument Flight Rules 

IHITL 

Integrated Human-ln-The-Loop 

IMS 

Integrated Master Schedule 

ISRP 

Integrated Systems Research Program 

ITAR 

International Traffic in Arms Regulations 

ITE or IT&E 

Integrated Test and Evaluation Subproject 

ITU-R 

International Telecommunication Union-Radiocommunication 

JOCA 

Jointly Optimal Collision Avoidance 

JPDO 

Joint Planning and Development Office 

JSC 

Johnson Space Center 

KDP 

Key Decision Point 

LxC 

Likelihood x Consequence 

LI 

Level 1 

L2 

Level 2 

LaRC 

Langley Research Center 

LOS 

Line of Sight 

LVC 

Live Virtual Constructive 
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Acronyms 



LVC-DE 

Live Virtual Constructive Distributed Environment 

MACS 

Multi-Aircraft Control System 

MIT 

Massachusetts Institute of Technology 

MOA 

Memorandum of Agreement 

MOPS 

Minimum Operational Performance Standards 

MOU 

Memorandum of Understanding 

MRB 

Management Review Board 

M/S 

Milestone 

NAS 

National Airspace System 

NOAA 

National Oceanic and Atmospheric Administration 

NRC 

National Research Council 

NSF 

National Science Foundation 

NTSB 

National Transportation Safety Board 

NWS 

National Weather Service 

OGA 

Other Government Agency 

OPNET 

Optimized Network Engineering Tools 

Ops 

Operations 

OSD 

Office of the Secretary of Defense 

PI 

Phase 1 

P2 

Phase 2 

PE/Co-PE 

Project Engineer/Co-Project Engineer 

PGCS 

Prototype Ground Control Station 
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Acronyms 



PI 

Progress Indicator 

PMR 

Project Management Review 

PMT 

Project Management Tool 

PO 

Project Office 

PPBE 

Planning Programming Budgeting and Execution 

PRD 

Project Requirements Document 

PT4 

Part Task Sim 4 

R&D 

Research & Development 

RFI 

Request for Information 

RGCS 

Research GCS 

RMB 

Risk Management Board 

RTCA SC 

RTCA Special Committee 

SA 

Situational Awareness/Separation Assurance 

SAA 

Sense and Avoid 

SARP 

Science and Research Panel 

SATCOM 

Satellite Communications 

SC 

Special Committee 

SEMP 

System Engineering Management Plan 

SGT 

Stinger Ghaffarian Technologies, Inc. 

SLAM 

Simultaneous Location and Mapping 

SMART-NAS 

Shadow Mode Assessment using Realistic Technologies for the NAS 

SMD 

Science Mission Directorate 
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Acronyms 



SME 

Subject Matter Expert 

SMP 

Schedule Management Plan 

SOA 

State of Art 

SP 

Schedule Package 

SRR 

System Requirements Review 

SS 

Self Separation 

SSCI 

Scientific Systems Company, Inc. 

STTR 

Small Business Technology Transfer Research 

sUAS 

small UAS 

SWAP 

Size, Weight, and Power 

SWRR 

Software Requirements Review 

TC 

Technical Challenge 

TCAS 

Traffic Alert and Collision Avoidance System 

TCAT 

Traffic Collision Avoidance Technology 

TOR 

Terms of Reference 

TPWG 

Test Planning Working Group 

TRR 

Test Readiness Review 

TTP 

Technology Transfer Plan 

TWP 

Technical Work Package 

UA 

Unmanned Aircraft 

UAS 

Unmanned Aircraft Systems 

UASCASl 

UAS Controller Acceptability Study 
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Acronyms 



UAV 

Unmanned Aircraft Vehicle 

UID 

Unique Identification 

UND 

University of North Dakota 

USFWS 

U.S. Fish and Wildlife Service 

USMC 

U.S. Marine Corps 

UTM 

UAS Traffic Management 

V&V 

Verification & Validation 

VFR 

Visual Flight Rules 

VLOS 

Visual Line of Sight 

VPN 

Virtual Private Network 

VSCS 

Vigilant Spirit Control Station 

VT 

Virginia Tech 

WBS 

Work Breakdown Structure 

WFF 

Wallops Flight Facility 

WG 

Working Group 

WRC 

World Radio Conference 

WYE 

Work Year Equivalent 

ZFW 

Dallas Fort Worth FAA Air Route Traffic Control Center 

ZOA 

Oakland FAA Air Route Traffic Control Center 
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